-- Logs begin at Tue 2022-08-30 15:16:41 UTC, end at Tue 2022-08-30 16:20:12 UTC. -- Aug 30 15:50:41.840651 dv-cinder-855058-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 15:50:41.849544 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 15:50:41 2022] *** Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: nodename: dv-cinder-855058-1-iscsi Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: machine: x86_64 Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: clock source: unix Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: pcre jit disabled Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: detected number of CPU cores: 4 Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: current working directory: / Aug 30 15:50:41.851515 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: detected binary path: /usr/bin/uwsgi-core Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: your processes number limit is 47680 Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: your memory page size is 4096 bytes Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: detected max file descriptor number: 2048 Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: lock engine: pthread robust mutexes Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: thunder lock: enabled Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 15:50:41.852231 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 15:50:41.890653 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: Python main interpreter initialized at 0x556a919909c0 Aug 30 15:50:41.890653 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: python threads support enabled Aug 30 15:50:41.890653 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: your server socket listen backlog is limited to 100 connections Aug 30 15:50:41.890653 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: your mercy for graceful operations on workers is 90 seconds Aug 30 15:50:41.890991 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 15:50:41.890991 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: *** Operational MODE: preforking *** Aug 30 15:50:41.891287 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: *** uWSGI is running in multiple interpreter mode *** Aug 30 15:50:41.891287 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: spawned uWSGI master process (pid: 105483) Aug 30 15:50:41.891477 dv-cinder-855058-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 15:50:41.892584 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: spawned uWSGI worker 1 (pid: 105484, cores: 1) Aug 30 15:50:41.892584 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: spawned uWSGI worker 2 (pid: 105485, cores: 1) Aug 30 15:50:41.892584 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 15:50:42.551801 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 15:50:42.552529 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 15:50:43.616877 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:50:43.616877 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: from cryptography.utils import int_from_bytes Aug 30 15:50:43.617688 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:50:43.617688 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: from cryptography.utils import int_from_bytes Aug 30 15:50:43.618063 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:50:43.618063 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: from cryptography.utils import int_from_bytes Aug 30 15:50:43.618177 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:50:43.618177 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: from cryptography.utils import int_from_bytes Aug 30 15:50:46.058368 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:50:46.059185 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:50:46.059185 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:50:46.059419 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:50:46.059671 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:50:46.060056 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.060376 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.060697 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.061015 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.061365 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.061597 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:50:46.062024 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.062115 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:50:46.062213 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.062303 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.062371 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:50:46.062576 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.062681 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:50:46.062835 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.062982 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:50:46.063146 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.063325 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.063457 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-1-iscsi {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.063652 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.063778 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.063972 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.064065 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.064300 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.064398 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.064612 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.064695 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.064925 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.065012 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.065270 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.065369 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.065593 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.065700 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.065918 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.066178 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.066263 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.066497 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.066628 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.066823 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-1-iscsi {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.066914 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.067144 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.067228 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.067444 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.067621 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.067739 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.067880 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068061 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068146 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068368 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068452 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068689 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068781 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.068996 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.069110 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.069365 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.069527 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.069763 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-1-iscsi {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.069845 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.070081 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.070163 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.070390 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.070518 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.070702 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.070795 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071043 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071135 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071352 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071439 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071677 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071800 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.071984 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.072069 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.072310 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.072410 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.072618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.072719 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.072943 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.073036 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-1-iscsi {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.073284 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.073373 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.073610 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.073699 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.073931 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074021 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074288 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074420 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074594 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074680 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074901 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.074985 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.075222 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.075319 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.075528 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.075626 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.075835 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.075930 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.076081 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.076224 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.076390 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.076544 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.076709 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.076850 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077030 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077174 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077372 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077501 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077628 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077815 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.077913 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.078123 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.078207 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.078441 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.078534 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.078746 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.078839 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079052 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079176 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079301 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079394 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079612 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079704 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.079934 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080021 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080237 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080318 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080543 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080634 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080800 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.080892 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.081049 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.081152 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.081397 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.081498 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.081720 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.081814 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082029 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082123 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082339 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082438 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082647 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082779 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.082955 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083048 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083264 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083347 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083571 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083666 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083880 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.083972 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.084187 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.084278 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.084505 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.084588 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.084819 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.084904 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.085123 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.085206 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.085453 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.085538 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.085760 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.085860 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086079 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086173 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086397 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086479 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086697 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086788 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.086944 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087029 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087244 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087337 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087543 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087633 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087857 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.087942 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.088161 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.088254 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.088465 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.088549 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.088769 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.088860 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.089071 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.089164 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.089399 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.089496 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.089728 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.089812 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090035 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090129 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090320 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090409 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090621 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090705 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.090919 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091010 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091221 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091305 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091524 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091613 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091824 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.091929 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.092129 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.092212 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.092427 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.092512 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.092732 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.092862 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093034 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093116 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093360 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093471 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093664 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093755 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.093972 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094054 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094274 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094366 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094577 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094660 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094877 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.094959 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.095180 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.095265 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.095479 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.095569 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.095792 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.095877 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.096100 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.096223 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.096402 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.096509 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.096703 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.096808 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097000 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097093 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097327 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097427 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097632 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097725 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.097934 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098028 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098234 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098330 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098534 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098629 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098833 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.098928 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.099133 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.099236 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.099433 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.099527 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.099731 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.099835 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100032 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100140 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100330 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100423 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100638 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100742 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.100950 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101052 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101273 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101381 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101580 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101683 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101882 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.101983 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.102181 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.102285 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.102482 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.102585 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.102788 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.102906 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.103090 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.103187 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.103388 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.103476 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.103707 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.103800 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.104005 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.104099 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.104322 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.104409 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.104627 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.104725 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.104934 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.105020 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.105278 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.105459 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.105638 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:50:46.105787 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.105933 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.106078 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.106248 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.106375 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.106569 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.106740 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.106872 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107011 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107195 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107340 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107510 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107596 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107825 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.107927 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.108137 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.108219 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.108442 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.108524 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.108758 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.108862 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.109068 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.109153 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.109409 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.109515 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.109718 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.109809 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110036 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110119 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110358 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110443 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110679 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110777 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.110994 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.111086 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.111306 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.111389 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.111613 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.111706 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.111923 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112006 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112229 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112319 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112547 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112632 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112864 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.112960 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.113522 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.113613 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.113852 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.113975 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.114161 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.114259 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.114479 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.114567 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.114789 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.114878 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.115099 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.115185 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.115406 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.115494 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.115714 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.115806 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116020 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116114 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116343 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116457 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116652 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116736 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.116970 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.117055 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.117306 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.117408 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.117617 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.117713 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.117928 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118011 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118238 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118334 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118545 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118628 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118853 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.118937 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.119155 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.119247 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.119458 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.119544 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.119761 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.119845 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.120068 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.120152 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.120372 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.120457 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.120692 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.120775 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121029 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121114 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121358 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121445 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121675 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121769 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.121980 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122108 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122287 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122371 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122590 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122674 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122895 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.122994 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.123198 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.123319 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.123505 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.123602 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.123811 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.123896 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.124110 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.124195 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.124430 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.124523 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.124737 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.124821 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125042 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125132 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125386 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125692 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125776 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.125997 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.126093 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.126302 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.126395 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.126608 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.126694 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.126920 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127005 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127231 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127321 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127532 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127654 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127852 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.127943 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.128161 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.128256 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.128466 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.128555 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.128784 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.128875 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.129090 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.129174 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.129419 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.129514 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.129734 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.129818 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130046 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130137 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130356 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130439 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130658 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130759 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.130965 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131050 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131266 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131350 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131571 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131663 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131873 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.131966 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.132178 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.132262 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.132481 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.132573 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.132781 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.132878 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.133084 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.133175 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.133410 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.133509 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.133718 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.133801 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134036 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134164 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134342 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134438 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134646 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134728 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.134945 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135027 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135245 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135344 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135553 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135637 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135858 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.135941 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.136160 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.136245 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.136463 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.136621 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.136873 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.136958 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.137205 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.137405 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.137552 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.137716 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.137886 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.138053 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.138200 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.138345 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.138539 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.138685 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.138844 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.139186 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.139492 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.139834 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.140168 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.140303 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.140489 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.140637 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.140812 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.141125 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.141465 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.141783 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.142096 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.142408 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.142499 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.142720 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.142806 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.143053 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.143240 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.143390 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.143665 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.143974 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.144299 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.144610 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.144778 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.144961 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.145060 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.145286 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.145373 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.145604 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.145702 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.145945 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.146028 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.146277 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.146360 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.146596 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.146685 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.146918 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147001 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147229 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147312 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147545 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147641 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147854 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.147938 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.148164 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.148246 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.148474 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.148558 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.148786 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.148877 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.149105 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.149191 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.149438 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.149526 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.149759 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.149857 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.150068 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.150151 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.150388 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.150474 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.150697 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.150783 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.151018 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.151104 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.151332 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.151571 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.151655 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.151951 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.152036 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.152400 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.152615 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.152737 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.152957 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.153042 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.153332 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.153541 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.153694 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.153836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.153974 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.154110 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.154311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156189 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156293 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156293 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156293 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156499 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156569 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156569 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156707 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156804 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156871 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.156936 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.157002 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.157169 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.157307 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.157535 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.157668 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.157859 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158011 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158176 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158309 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158492 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158642 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158807 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.158998 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.159104 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.159187 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.159411 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.159544 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.159724 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.159871 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160040 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160170 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160334 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160425 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160655 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160758 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.160962 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.161065 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.161277 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.161369 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.161595 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.161686 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.161914 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162012 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162218 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162308 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162522 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162611 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162828 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.162970 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.163135 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.163234 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.163469 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.163559 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.163770 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.163860 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.164071 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.164168 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.164384 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.164476 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.164676 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.164762 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165003 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165104 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165321 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165410 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165635 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165723 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.165941 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.166038 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.166258 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.166343 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.166568 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.166677 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.166880 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.167047 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.167194 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.167281 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.167507 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.167601 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.167874 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168061 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168195 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168324 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168502 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168648 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168813 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.168956 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.169124 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.169287 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.169453 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.169598 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.169764 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.169900 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.170083 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.170208 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.170521 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.170665 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.170998 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.171085 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.171312 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.171398 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.171632 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.171718 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.171954 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.172041 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.172316 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.172401 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.172645 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.172745 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.172976 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.173072 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.173311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.173413 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.173619 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.173707 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.173924 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174226 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174313 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174527 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174612 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174833 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.174918 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.175138 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.175236 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.175428 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.175516 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.175727 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.175820 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176027 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176128 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176326 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176418 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176624 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176717 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.176942 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177071 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177259 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177363 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177546 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177642 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177846 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.177931 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.178144 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.178230 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.178447 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.178545 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.178747 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.178839 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179062 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179158 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179364 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179450 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179663 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179756 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.179959 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180050 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180257 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180345 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180590 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180682 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180892 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.180977 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.181245 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.181335 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.181571 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.181657 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.181877 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.181962 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.182180 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.182275 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.182481 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.182565 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.182800 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.182893 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.183097 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.183182 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.183401 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.183501 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.183717 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.183812 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184029 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184124 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184330 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184417 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184644 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184740 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.184953 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185039 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185299 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185389 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185578 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185675 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185880 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.185966 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.186182 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.186267 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.186482 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.186575 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.186778 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.186863 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187089 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187186 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187391 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187476 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187689 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187773 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.187987 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188072 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188291 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188378 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188593 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188679 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.188971 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.189190 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.189296 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.189510 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.189595 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.189814 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.189911 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.190109 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.190195 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.190407 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.190494 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.190706 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.190806 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191009 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191094 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191402 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191606 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191769 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.191924 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192011 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192224 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192308 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192522 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192615 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192821 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.192908 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.193122 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.193208 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.193446 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.193541 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.193744 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.193829 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194046 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194132 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194379 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194513 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194661 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194746 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.194960 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195045 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195269 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195388 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195562 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195660 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195858 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.195957 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.196155 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.196259 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.196453 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.196547 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.196745 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.196849 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197040 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197136 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197361 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197462 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197657 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197763 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.197955 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198041 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198267 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198352 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198565 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198659 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.198950 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.199232 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.199407 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.199603 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.199742 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.199944 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.200063 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.200242 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.200555 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.200693 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.200878 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.200968 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.201185 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.201301 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.201521 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.201627 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.201827 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.201960 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.202132 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.202218 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.202438 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.202533 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.202736 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.202823 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203044 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203138 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203352 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203453 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203662 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203755 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.203960 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204046 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204257 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204356 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204576 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204662 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204879 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.204965 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.205185 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.205294 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.205531 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.205629 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.205841 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.205925 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.206157 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.206244 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.206454 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.206551 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.206758 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.206844 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207064 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207151 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207367 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207489 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207673 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207767 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.207978 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208064 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208283 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208367 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208589 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208683 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208896 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.208982 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.209202 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.209339 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.209529 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.209626 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.209833 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.209917 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.210133 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.210217 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.210439 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.210533 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.210737 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.210826 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211139 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211362 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211455 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211661 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211746 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.211964 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212050 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212266 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212352 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212573 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212657 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212873 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.212956 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.213319 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.213419 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.213630 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.213716 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.213936 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214022 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214238 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214324 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214546 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214630 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214879 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.214971 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.215199 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.215285 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.215579 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.215685 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.215817 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.215912 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.216231 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.216318 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.216542 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.216627 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.216852 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.216946 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.217157 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.217306 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.217562 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.217650 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.217864 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.217962 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.218168 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.218261 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.218487 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.218575 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.218789 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.218884 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219086 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219171 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219382 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219475 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219698 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219788 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.219996 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.220082 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.220310 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.220395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.220717 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.220806 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.221023 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.221108 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.221342 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.221431 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.221760 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.221847 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.222071 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.222164 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.222388 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.222483 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.222711 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.222817 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223032 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223127 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223354 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223446 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223654 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223740 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.223965 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224052 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224271 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224356 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224590 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224682 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224906 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.224990 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.225211 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.225313 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.225540 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.225652 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.225844 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.225940 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.226163 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.226264 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.226476 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.226571 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.226785 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227234 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227322 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227402 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227482 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227570 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227796 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.227890 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.228097 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.228183 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.228413 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.228500 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.228733 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.228819 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229032 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229118 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229355 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229446 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229659 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229744 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.229957 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.230055 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.230280 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.230368 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.230627 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.230755 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.230928 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231017 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231238 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231328 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231546 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231631 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231850 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.231944 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.232148 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.232243 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.232446 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.232535 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.232763 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.232857 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.233061 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.233154 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.233408 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.233495 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.233719 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.233815 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234040 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234125 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234363 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234450 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234669 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234768 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.234992 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.235078 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.235300 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.235607 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.235741 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.235933 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.236049 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.236229 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.236367 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.236525 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.236721 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.236861 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.237035 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.237174 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.237413 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.237501 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.237816 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.238137 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.238766 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.238853 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.239104 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.239190 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.239426 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.239514 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.239742 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.239834 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240057 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240153 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240375 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240461 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240676 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240763 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.240975 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.241069 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.241302 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.241411 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.241608 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.241702 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.241909 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242003 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242210 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242296 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242513 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242599 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242813 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.242900 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.243112 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.243206 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.243411 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.243506 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.243712 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.243799 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244016 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244101 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244332 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244426 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244636 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244732 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.244942 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245028 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245266 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245369 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245563 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245658 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245889 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.245991 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.246202 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.246305 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.246529 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.246616 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.246836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.246928 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.247152 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.247246 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.247463 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.247550 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.247773 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.247855 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.248088 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.248189 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.248402 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.248489 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.248714 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.248807 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249027 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249125 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249365 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249461 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249668 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249766 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.249981 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.250077 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.250291 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.250384 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.250598 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.250684 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.250916 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.251117 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.251235 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.251444 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.251754 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.251840 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252062 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252158 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252372 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252458 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252684 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252778 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.252994 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.253082 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.253325 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.253426 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.253636 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.253737 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.253942 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254030 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254247 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254334 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254561 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254656 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254875 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.254960 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.255196 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.255288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.255518 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.255618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.255835 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.255921 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.256150 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.256244 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.256459 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.256547 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.256770 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.256857 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.257086 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.257172 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.257427 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.257524 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.257742 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.257829 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258052 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258148 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258365 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258452 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258674 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258760 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.258983 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.259086 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.259291 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.259423 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.259601 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.259694 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.259907 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260003 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260216 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260303 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260521 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260614 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260829 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.260926 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.261138 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.261255 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.261525 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.261648 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.261866 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262004 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262197 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262370 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262534 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262631 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262861 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.262955 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.263177 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.263265 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.263490 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.263723 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.263811 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.264035 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.264314 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.264399 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.264634 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.264728 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.264971 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.265065 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.265310 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.265400 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.265627 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.265730 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.265949 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266036 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266252 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266347 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266553 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266641 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266858 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.266956 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.267161 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.267248 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.267478 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.267564 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.267791 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.267885 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.268098 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.268185 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.268422 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.268510 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.268734 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.268820 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.269040 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.269140 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.269386 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.269591 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.269700 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.269936 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.270236 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.270340 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.270553 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.270640 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.270876 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.270962 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.271190 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.271288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.271493 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.271592 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.271810 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.271897 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.272112 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.272207 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.272413 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.272499 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.272722 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.272844 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273027 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273123 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273347 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273436 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273649 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273748 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.273954 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274042 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274259 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274344 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274556 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274641 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274866 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.274952 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.275164 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.275248 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.275473 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.275557 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.275777 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.275872 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276075 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276161 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276375 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276461 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276681 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276769 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.276981 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.277067 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.277364 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.277476 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.277673 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.277759 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.277977 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278063 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278283 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278386 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278588 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278674 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278900 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.278995 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.279198 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.279297 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.279505 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.279634 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.279802 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.279895 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.280105 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.280201 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.280404 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.280489 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.280713 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.280808 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281040 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281126 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281365 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281464 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281682 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281776 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.281987 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.282076 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.282303 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.282389 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.282609 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.282696 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.282914 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.283008 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.283229 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.283314 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.283540 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.283627 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.283887 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.284057 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.284187 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.284386 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.284698 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.284792 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285031 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285117 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285375 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285463 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285676 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285776 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.285977 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286064 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286278 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286372 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286595 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286695 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286900 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.286994 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.287205 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.287299 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.287509 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.287604 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.287814 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.287900 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.288116 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.288202 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.288421 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.288514 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.288728 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.288813 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289038 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289123 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289377 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289468 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289689 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289775 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.289997 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.290083 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.290305 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.290395 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.290607 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.290693 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.290912 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291006 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291217 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291302 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291525 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291611 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291840 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.291934 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.292154 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.292240 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.292465 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.292559 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.292798 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.292903 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.293106 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.293199 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.293437 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.293525 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.293742 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.293837 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294050 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294135 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294362 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294451 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294672 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294760 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.294989 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.295076 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.295321 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.295408 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.295637 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.295733 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.295943 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.296037 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.296339 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.296433 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.296656 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.296743 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.296962 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.297057 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.297300 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.297404 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.297614 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.297699 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.297917 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298233 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298328 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298536 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298632 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298855 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.298947 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.299167 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.299254 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.299490 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.299575 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.299808 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.299894 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.300113 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.300231 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.300410 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.300523 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.300702 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.300789 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301005 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301092 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301338 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301426 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301645 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301751 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.301941 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302029 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302238 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302324 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302539 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302633 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302839 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.302931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.303135 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.303234 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.303431 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.303526 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.303726 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.303811 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304028 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304128 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304323 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304423 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304619 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304706 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.304919 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.305010 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.305257 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.305364 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.305529 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.305616 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.305827 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.306002 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.306129 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.306424 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.306725 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.307015 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.307309 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.307603 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.307951 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.308066 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.308272 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.308703 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.308969 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.309300 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.309616 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.309922 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.310235 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.310366 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.310546 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.310690 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.310857 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.311027 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.311162 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.311358 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.311489 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.311692 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.311799 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312017 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312104 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312344 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312431 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312693 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312779 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.312997 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.313090 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.313328 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.313427 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.313645 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.313734 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.313964 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314050 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314265 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314404 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314583 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314669 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314899 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.314995 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.315214 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.315311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.315526 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.315613 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.315834 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.315920 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.316158 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.316258 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.316462 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.316597 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.316766 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.316861 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.317068 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.317164 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.317400 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.317498 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.317706 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.317793 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318020 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318116 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318323 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318410 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318629 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318718 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.318939 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.319026 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.319250 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.319337 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.319572 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.319658 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.319892 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320019 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320196 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320283 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320551 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320715 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320885 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.320972 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.321198 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.321316 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.321535 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.321635 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.321851 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.321939 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.322167 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.322261 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.322479 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.322572 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.322786 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.322873 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.323087 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.323174 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.323328 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105484) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:50:46.323479 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.323706 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.324049 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.324378 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.324711 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.325026 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.325387 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.325720 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.326070 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.326386 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.326733 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.327066 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.327383 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.327699 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.328008 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:50:46.328253 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105485) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:50:46.480166 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO dbcounter [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Registered counter for database nova_api Aug 30 15:50:46.483312 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO dbcounter [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Registered counter for database nova_api Aug 30 15:50:46.503237 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_db.sqlalchemy.engines [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.506605 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.510212 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writer thread running {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.514113 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writer thread running {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.567395 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.context [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2381055-522d-452d-a836-2df87ca71581(cell1) {{(pid=105484) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 15:50:46.571099 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.context [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2381055-522d-452d-a836-2df87ca71581(cell1) {{(pid=105485) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 15:50:46.571331 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:50:46.571785 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:50:46.573379 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:50:46.574119 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:50:46.574687 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:50:46.574983 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_concurrency.lockutils [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:50:46.575468 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_concurrency.lockutils [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:50:46.576664 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:50:46.577086 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_concurrency.lockutils [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:50:46.577844 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_concurrency.lockutils [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:50:46.578287 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_concurrency.lockutils [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:50:46.578663 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO dbcounter [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Registered counter for database nova_cell0 Aug 30 15:50:46.580275 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_concurrency.lockutils [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105485) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:50:46.582326 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO dbcounter [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Registered counter for database nova_cell0 Aug 30 15:50:46.582657 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO dbcounter [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Registered counter for database nova_cell1 Aug 30 15:50:46.586598 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO dbcounter [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Registered counter for database nova_cell1 Aug 30 15:50:46.590165 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_db.sqlalchemy.engines [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.592279 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_db.sqlalchemy.engines [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.594710 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.596075 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.598898 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writer thread running {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.602206 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writer thread running {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.604495 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writer thread running {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.604988 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writer thread running {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.750073 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO dbcounter [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Registered counter for database nova_cell0 Aug 30 15:50:46.752043 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO dbcounter [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Registered counter for database nova_cell0 Aug 30 15:50:46.761038 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_db.sqlalchemy.engines [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105484) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.763172 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG oslo_db.sqlalchemy.engines [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105485) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:50:46.765640 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writer thread running {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:46.767497 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writer thread running {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:50:47.104481 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: WARNING keystonemiddleware.auth_token [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:50:47.105150 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: WARNING keystonemiddleware.auth_token [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:50:47.111889 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: WARNING keystonemiddleware.auth_token [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:50:47.112482 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: WARNING keystonemiddleware.auth_token [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:50:47.456062 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: WARNING keystonemiddleware.auth_token [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:50:47.462156 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: WARNING keystonemiddleware.auth_token [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:50:47.462289 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: WARNING keystonemiddleware.auth_token [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:50:47.467574 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a919909c0 pid: 105484 (default app) Aug 30 15:50:47.468326 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: WARNING keystonemiddleware.auth_token [None req-b0e48f41-79c0-44ed-900d-7af8f879c1cb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:50:47.469665 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:50:47.470922 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] 10.222.0.20 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001828 Aug 30 15:50:47.471340 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 788 bytes} [Tue Aug 30 15:50:47 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:50:47.473681 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556a919909c0 pid: 105485 (default app) Aug 30 15:52:05.683088 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:05.684827 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002158 Aug 30 15:52:05.685572 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 2/2] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:05.697853 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_api:SELECT=3 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:05.698982 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_cell1:SELECT=3 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:05.699819 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_cell0:SELECT=3 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:05.700934 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:06.570246 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-9e514527-8883-4565-97b3-d6c19336128d admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:06.601837 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-9e514527-8883-4565-97b3-d6c19336128d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.909133 Aug 30 15:52:06.602802 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 1/3] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 30 15:52:05 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 911 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:08.960638 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:08.960638 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-46d79a5d-d03f-4dd2-b3e8-c2c7f9a71abc None None] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001418 Aug 30 15:52:08.960638 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 3/4] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:09.390128 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-b6d6c048-962d-4572-a326-474ec8dc0c1c admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "ram": 256, "rxtx_factor": 1.0, "swap": 0, "name": "cirros256", "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:09.448906 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-b6d6c048-962d-4572-a326-474ec8dc0c1c admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.482307 Aug 30 15:52:09.449626 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 2/5] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:09.464299 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_api:SELECT=3 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:09.465531 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_cell1:SELECT=3 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:09.466326 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_cell0:SELECT=3 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:09.467415 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:09.675486 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-461ac7bf-87ac-44c2-aae0-2133c3a72030 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:09.740677 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-461ac7bf-87ac-44c2-aae0-2133c3a72030 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.282490 Aug 30 15:52:09.741307 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 4/6] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 30 15:52:09 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:12.058745 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-b6d6c048-962d-4572-a326-474ec8dc0c1c admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:12.059949 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-b6d6c048-962d-4572-a326-474ec8dc0c1c admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001631 Aug 30 15:52:12.060624 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 3/7] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:12.707781 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-807d3e47-2a12-4b3b-b00f-0d1134e0a216 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d1", "vcpus": 1, "swap": 0, "rxtx_factor": 1.0, "disk": 5, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:12.751777 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-807d3e47-2a12-4b3b-b00f-0d1134e0a216 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.683902 Aug 30 15:52:12.752865 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 5/8] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:12.765521 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-f205dd55-05f6-4e22-931f-a3bfc7a2d502 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:12.804458 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-f205dd55-05f6-4e22-931f-a3bfc7a2d502 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042939 Aug 30 15:52:12.805294 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 4/9] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 30 15:52:12 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:15.226850 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-807d3e47-2a12-4b3b-b00f-0d1134e0a216 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:15.228448 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-807d3e47-2a12-4b3b-b00f-0d1134e0a216 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002259 Aug 30 15:52:15.228886 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 6/10] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:15.640212 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-8d0be5b6-e673-4b23-a02d-32a4a0457388 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "disk": 10, "swap": 0, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "rxtx_factor": 1.0, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:15.660193 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-8d0be5b6-e673-4b23-a02d-32a4a0457388 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.425019 Aug 30 15:52:15.660744 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 5/11] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:15.672960 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-261a0779-c6d5-471e-b503-0bcb72dbb475 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:15.697939 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-261a0779-c6d5-471e-b503-0bcb72dbb475 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028713 Aug 30 15:52:15.698511 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 7/12] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 30 15:52:15 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:18.066020 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-8d0be5b6-e673-4b23-a02d-32a4a0457388 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:18.067046 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-8d0be5b6-e673-4b23-a02d-32a4a0457388 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 30 15:52:18.067450 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 6/13] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:18.539414 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-77d389d9-4015-4bb1-a7c8-30c74e545825 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "disk": 10, "vcpus": 2, "swap": 0, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:18.562993 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-77d389d9-4015-4bb1-a7c8-30c74e545825 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.489007 Aug 30 15:52:18.563539 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 8/14] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:18.575832 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-f7bd98c1-d19f-408d-84ab-3bc76b682daa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:18.600354 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-f7bd98c1-d19f-408d-84ab-3bc76b682daa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028150 Aug 30 15:52:18.600911 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 7/15] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 30 15:52:18 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:20.939338 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-77d389d9-4015-4bb1-a7c8-30c74e545825 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:20.940995 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-77d389d9-4015-4bb1-a7c8-30c74e545825 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002052 Aug 30 15:52:20.941674 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 9/16] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:21.377456 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-19a5b13c-3d20-451b-bcb9-375814a3c1eb admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "vcpus": 4, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "id": "d4"}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:21.400672 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-19a5b13c-3d20-451b-bcb9-375814a3c1eb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.452724 Aug 30 15:52:21.403778 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 8/17] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:21.413556 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-8df24106-0aae-460a-92f1-dae3e9471cad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:21.440353 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-8df24106-0aae-460a-92f1-dae3e9471cad admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030267 Aug 30 15:52:21.441119 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 10/18] 10.222.0.20 () {64 vars in 1336 bytes} [Tue Aug 30 15:52:21 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:24.158110 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-19a5b13c-3d20-451b-bcb9-375814a3c1eb admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:24.159383 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-19a5b13c-3d20-451b-bcb9-375814a3c1eb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001986 Aug 30 15:52:24.159858 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 9/19] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:24 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:24.604069 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-599b33f6-4f58-40dd-ab3f-896ef9e3b284 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:24.632512 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-599b33f6-4f58-40dd-ab3f-896ef9e3b284 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.464958 Aug 30 15:52:24.633166 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 11/20] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 30 15:52:24 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:52:27.143323 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-19a5b13c-3d20-451b-bcb9-375814a3c1eb admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:27.144595 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-19a5b13c-3d20-451b-bcb9-375814a3c1eb admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001796 Aug 30 15:52:27.145075 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 10/21] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:27.552785 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-93e3f604-e998-4bcf-9631-2d04718f2e0d admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "name": "m1.tiny", "id": "1", "os-flavor-access:is_public": true, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "ram": 512}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:27.579858 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-93e3f604-e998-4bcf-9631-2d04718f2e0d admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.428141 Aug 30 15:52:27.580529 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 12/22] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:27 2022] POST /compute/v2.1/flavors => generated 402 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 15:52:27.595107 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-5058d942-90e6-41af-96f5-0aa74e54dfbb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:27.621529 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-5058d942-90e6-41af-96f5-0aa74e54dfbb admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030163 Aug 30 15:52:27.622104 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 11/23] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 30 15:52:27 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:30.156739 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-93e3f604-e998-4bcf-9631-2d04718f2e0d admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:30.157908 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-93e3f604-e998-4bcf-9631-2d04718f2e0d admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Aug 30 15:52:30.158313 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:30.586925 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-d4d9094d-679d-4b0e-b886-b9d3f540f5aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 20}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:30.611256 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-d4d9094d-679d-4b0e-b886-b9d3f540f5aa admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.444422 Aug 30 15:52:30.611675 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 12/25] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:30 2022] POST /compute/v2.1/flavors => generated 405 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:30.627413 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-65ecd5b2-9a97-4b39-9173-abf9151b60ca admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:30.659273 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-65ecd5b2-9a97-4b39-9173-abf9151b60ca admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036552 Aug 30 15:52:30.660020 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 14/26] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 30 15:52:30 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:33.009068 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-d4d9094d-679d-4b0e-b886-b9d3f540f5aa admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:33.010112 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-d4d9094d-679d-4b0e-b886-b9d3f540f5aa admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Aug 30 15:52:33.010503 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 13/27] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:33.419864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-8c93158b-5df7-47f1-bb5c-1082ad9b99ed admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "rxtx_factor": 1.0, "id": "3", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0, "ram": 4096}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:33.439670 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-8c93158b-5df7-47f1-bb5c-1082ad9b99ed admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.422944 Aug 30 15:52:33.440516 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 15/28] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:33 2022] POST /compute/v2.1/flavors => generated 406 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 15:52:33.452940 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-bb4e384a-8936-497d-8cd3-efed66b55ae7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:33.479850 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-bb4e384a-8936-497d-8cd3-efed66b55ae7 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030087 Aug 30 15:52:33.479850 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 14/29] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 30 15:52:33 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:35.799641 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-8c93158b-5df7-47f1-bb5c-1082ad9b99ed admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:35.801096 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-8c93158b-5df7-47f1-bb5c-1082ad9b99ed admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001594 Aug 30 15:52:35.801392 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 16/30] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:36.243823 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-cc2978ba-26f0-449d-a312-f960e76f6106 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "vcpus": 4, "ram": 8192, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:36.249603 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:52:36.269910 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-cc2978ba-26f0-449d-a312-f960e76f6106 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.462648 Aug 30 15:52:36.270469 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 15/31] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:35 2022] POST /compute/v2.1/flavors => generated 405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:36.282641 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-19bab912-97e7-4b7d-8fdb-661720180034 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:36.312973 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-19bab912-97e7-4b7d-8fdb-661720180034 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034151 Aug 30 15:52:36.325674 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 17/32] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 30 15:52:36 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:52:38.686149 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-cc2978ba-26f0-449d-a312-f960e76f6106 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:52:38.687159 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-cc2978ba-26f0-449d-a312-f960e76f6106 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Aug 30 15:52:38.687553 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 16/33] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:52:39.117987 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-83f35ab9-840d-4012-8c25-2c8f86b8b4cd admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "os-flavor-access:is_public": true, "disk": 160, "id": "5", "rxtx_factor": 1.0, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 8}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:39.144420 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-83f35ab9-840d-4012-8c25-2c8f86b8b4cd admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.450765 Aug 30 15:52:39.145416 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 18/34] 10.222.0.20 () {64 vars in 1283 bytes} [Tue Aug 30 15:52:38 2022] POST /compute/v2.1/flavors => generated 408 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:52:39.158111 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2580a76a-7f70-49b3-9b13-79adab32d954 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:52:39.189892 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2580a76a-7f70-49b3-9b13-79adab32d954 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035798 Aug 30 15:52:39.190737 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 17/35] 10.222.0.20 () {64 vars in 1333 bytes} [Tue Aug 30 15:52:39 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:53:00.867571 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-83f35ab9-840d-4012-8c25-2c8f86b8b4cd admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:00.869055 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-83f35ab9-840d-4012-8c25-2c8f86b8b4cd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002506 Aug 30 15:53:00.869788 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 19/36] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:00.883927 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:01.298736 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-4f8a5f28-238d-472f-bde4-edec90c91207 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:01.318247 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-4f8a5f28-238d-472f-bde4-edec90c91207 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.442009 Aug 30 15:53:01.318786 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 18/37] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 30 15:53:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:53:02.394956 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-83f35ab9-840d-4012-8c25-2c8f86b8b4cd admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:02.395979 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-83f35ab9-840d-4012-8c25-2c8f86b8b4cd admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001489 Aug 30 15:53:02.396374 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 20/38] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:02.943017 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-00b46ec2-fc85-4e45-8f22-7e4f3517155c admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:02.948844 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.wsgi [None req-00b46ec2-fc85-4e45-8f22-7e4f3517155c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-00b46ec2-fc85-4e45-8f22-7e4f3517155c admin admin] Request method failure captured: Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Accept: application/json Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Accept-Encoding: gzip, deflate Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Connection: keep-alive Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Content-Length: 0 Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Host: 10.222.0.20 Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Openstack-Api-Version: compute 2.90 Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Openstack-System-Scope: None Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: User-Agent: python-novaclient Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Auth-Token: gAAAAABjDjJetbxzb610ln0Ve__USDqT3O8577noTfIcGewADknkmy1bpOv05ULBXpvqRJ6xSjTfE_K4VptmX2y05gZ9AdkCILEMHIYXTDU8-cpKsxFRLR6196jiGI42Z5wn9FosDAhe3MTV4e568zgD_Q1yZvQ43pZyn5R3y2mtom2jujf0klQ Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Domain-Id: None Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Domain-Name: None Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Identity-Status: Confirmed Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Is-Admin-Project: True Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Domain-Id: default Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Domain-Name: Default Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Name: admin Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Role: reader,admin,member Aug 30 15:53:02.952130 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Roles: reader,admin,member Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant: admin Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant-Name: admin Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User: admin Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Domain-Id: default Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Domain-Name: Default Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Id: 8b9160d3cbae47a48dc9dee882da999b Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Name: admin Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: method: > Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: exception: Flavor 42 could not be found. Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: action_args: {'id': '42'} Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:53:02.953827 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:02.954798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:02.956009 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-00b46ec2-fc85-4e45-8f22-7e4f3517155c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:53:02.957341 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-00b46ec2-fc85-4e45-8f22-7e4f3517155c admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.421933 Aug 30 15:53:02.957341 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 19/39] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 30 15:53:02 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 423 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:02.963628 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-a6e57609-41e5-4ce3-be86-a57c9e8761ab admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:02.967976 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:53:02.991375 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-a6e57609-41e5-4ce3-be86-a57c9e8761ab admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.031294 Aug 30 15:53:02.991994 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 21/40] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 30 15:53:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:53:03.005133 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-1116cf33-2990-4f6b-bf65-75db4821c187 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:03.034650 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-1116cf33-2990-4f6b-bf65-75db4821c187 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035632 Aug 30 15:53:03.035169 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 20/41] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 30 15:53:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:53:03.045289 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-3933d66c-cf45-4233-bcc6-4c150dc1db86 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:03.052144 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.wsgi [None req-3933d66c-cf45-4233-bcc6-4c150dc1db86 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-3933d66c-cf45-4233-bcc6-4c150dc1db86 admin admin] Request method failure captured: Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Accept: application/json Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Accept-Encoding: gzip, deflate Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Connection: keep-alive Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Content-Length: 0 Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Host: 10.222.0.20 Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Openstack-Api-Version: compute 2.90 Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Openstack-System-Scope: None Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: User-Agent: python-novaclient Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Auth-Token: gAAAAABjDjJetbxzb610ln0Ve__USDqT3O8577noTfIcGewADknkmy1bpOv05ULBXpvqRJ6xSjTfE_K4VptmX2y05gZ9AdkCILEMHIYXTDU8-cpKsxFRLR6196jiGI42Z5wn9FosDAhe3MTV4e568zgD_Q1yZvQ43pZyn5R3y2mtom2jujf0klQ Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Domain-Id: None Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Domain-Name: None Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Identity-Status: Confirmed Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Is-Admin-Project: True Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Domain-Id: default Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Domain-Name: Default Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Name: admin Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Role: reader,admin,member Aug 30 15:53:03.055561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Roles: reader,admin,member Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant: admin Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant-Name: admin Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User: admin Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Domain-Id: default Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Domain-Name: Default Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Id: 8b9160d3cbae47a48dc9dee882da999b Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Name: admin Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: method: > Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: exception: Flavor 42 could not be found. Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: action_args: {'id': '42'} Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:53:03.057143 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:03.058107 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:03.059464 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-3933d66c-cf45-4233-bcc6-4c150dc1db86 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:53:03.060667 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-3933d66c-cf45-4233-bcc6-4c150dc1db86 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015665 Aug 30 15:53:03.060920 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 22/42] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 30 15:53:03 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 20 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:04.046774 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-1116cf33-2990-4f6b-bf65-75db4821c187 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:04.047852 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-1116cf33-2990-4f6b-bf65-75db4821c187 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Aug 30 15:53:04.048251 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 21/43] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:04.600433 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-4f0073e9-ed95-44e7-80c0-57844adc9064 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:04.606307 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.wsgi [None req-4f0073e9-ed95-44e7-80c0-57844adc9064 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-4f0073e9-ed95-44e7-80c0-57844adc9064 admin admin] Request method failure captured: Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Accept: application/json Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Accept-Encoding: gzip, deflate Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Connection: keep-alive Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Content-Length: 0 Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Host: 10.222.0.20 Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Openstack-Api-Version: compute 2.90 Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Openstack-System-Scope: None Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: User-Agent: python-novaclient Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Auth-Token: gAAAAABjDjJfGEuvz3-WKUgbFjcG540sZYv5wDOajyl5E4maYkfg6OyhzSp_82HFyMYwHoB9E7LwYgGhe3WylQEn_oh4WwPJSZM6aK_7aSJmrZweo3BgrSty39_AMmANiL0chWCaC4ApeKFJYgqWgcjcmyPsVKRnXO8JAEctmVhsu1tzzIMsglA Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Domain-Id: None Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Domain-Name: None Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Identity-Status: Confirmed Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Is-Admin-Project: True Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Domain-Id: default Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Domain-Name: Default Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Name: admin Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Role: reader,admin,member Aug 30 15:53:04.607776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Roles: reader,admin,member Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant: admin Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant-Name: admin Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User: admin Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Domain-Id: default Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Domain-Name: Default Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Id: 8b9160d3cbae47a48dc9dee882da999b Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Name: admin Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: method: > Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: exception: Flavor 84 could not be found. Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: action_args: {'id': '84'} Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:53:04.609618 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:04.610776 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.612864 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-4f0073e9-ed95-44e7-80c0-57844adc9064 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:53:04.614717 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-4f0073e9-ed95-44e7-80c0-57844adc9064 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.422291 Aug 30 15:53:04.614717 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 23/44] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 30 15:53:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 424 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 30 15:53:04.621809 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-cce75a81-c5e6-4b8e-8215-86bd9930c257 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:04.637413 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-cce75a81-c5e6-4b8e-8215-86bd9930c257 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019174 Aug 30 15:53:04.637964 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 22/45] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 30 15:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:53:04.650340 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-062f1a2d-d8b9-4bfe-af93-e440debdae55 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:04.665988 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-062f1a2d-d8b9-4bfe-af93-e440debdae55 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019542 Aug 30 15:53:04.666660 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 24/46] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 30 15:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:53:04.679012 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-78e660cc-4589-4d44-ad34-ef342bdb74e5 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:04.686984 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.wsgi [None req-78e660cc-4589-4d44-ad34-ef342bdb74e5 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-78e660cc-4589-4d44-ad34-ef342bdb74e5 admin admin] Request method failure captured: Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Accept: application/json Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Accept-Encoding: gzip, deflate Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Connection: keep-alive Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Content-Length: 0 Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Host: 10.222.0.20 Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Openstack-Api-Version: compute 2.90 Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Openstack-System-Scope: None Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: User-Agent: python-novaclient Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Auth-Token: gAAAAABjDjJfGEuvz3-WKUgbFjcG540sZYv5wDOajyl5E4maYkfg6OyhzSp_82HFyMYwHoB9E7LwYgGhe3WylQEn_oh4WwPJSZM6aK_7aSJmrZweo3BgrSty39_AMmANiL0chWCaC4ApeKFJYgqWgcjcmyPsVKRnXO8JAEctmVhsu1tzzIMsglA Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Domain-Id: None Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Domain-Name: None Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Identity-Status: Confirmed Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Is-Admin-Project: True Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Domain-Id: default Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Domain-Name: Default Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Name: admin Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Role: reader,admin,member Aug 30 15:53:04.688931 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Roles: reader,admin,member Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant: admin Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant-Name: admin Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User: admin Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Domain-Id: default Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Domain-Name: Default Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Id: 8b9160d3cbae47a48dc9dee882da999b Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Name: admin Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: method: > Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: exception: Flavor 84 could not be found. Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: action_args: {'id': '84'} Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:53:04.690395 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:04.691288 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:04.692449 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-78e660cc-4589-4d44-ad34-ef342bdb74e5 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:53:04.693623 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-78e660cc-4589-4d44-ad34-ef342bdb74e5 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.017170 Aug 30 15:53:04.693623 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 23/47] 10.222.0.20 () {60 vars in 1190 bytes} [Tue Aug 30 15:53:04 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:05.694585 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-062f1a2d-d8b9-4bfe-af93-e440debdae55 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:05.695692 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-062f1a2d-d8b9-4bfe-af93-e440debdae55 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001564 Aug 30 15:53:05.696096 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 25/48] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:06.258505 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-1d8f3ecf-5164-4db8-91a6-803df67ead47 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:06.264765 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.wsgi [None req-1d8f3ecf-5164-4db8-91a6-803df67ead47 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-1d8f3ecf-5164-4db8-91a6-803df67ead47 admin admin] Request method failure captured: Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Accept: application/json Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Accept-Encoding: gzip, deflate Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Connection: keep-alive Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Content-Length: 0 Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Host: 10.222.0.20 Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Openstack-Api-Version: compute 2.90 Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Openstack-System-Scope: None Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: User-Agent: python-novaclient Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Auth-Token: gAAAAABjDjJhpVe25f6CdP077O6A-WvS1QTGB95TlUv8nVym8gPcsgXHdeIuugokG7S7oEJbI81GJIBKw7zHxzkGqm-QXDqFvWhqEbodFf7QXRQ46QvkHg-jtZQu1GDcEbWfjse0RmnpjKPxrmSrUZMPW0k_S-trDL2VRNe6CSaj0lQ1jNl2Vsc Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Domain-Id: None Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Domain-Name: None Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Identity-Status: Confirmed Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Is-Admin-Project: True Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Domain-Id: default Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Domain-Name: Default Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Project-Name: admin Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Role: reader,admin,member Aug 30 15:53:06.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Roles: reader,admin,member Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant: admin Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-Tenant-Name: admin Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User: admin Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Domain-Id: default Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Domain-Name: Default Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Id: 8b9160d3cbae47a48dc9dee882da999b Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: X-User-Name: admin Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: method: > Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: exception: Flavor 451 could not be found. Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: action_args: {'id': '451'} Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:53:06.267816 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:06.268688 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.269836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-1d8f3ecf-5164-4db8-91a6-803df67ead47 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105485) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:53:06.271216 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-1d8f3ecf-5164-4db8-91a6-803df67ead47 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.428918 Aug 30 15:53:06.271216 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 24/49] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 30 15:53:05 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 430 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:06.278217 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-09cec462-499d-45d9-9eb4-0ede54078461 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:06.293851 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-09cec462-499d-45d9-9eb4-0ede54078461 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019266 Aug 30 15:53:06.294421 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 26/50] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 30 15:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:53:06.304045 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:06.319684 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019180 Aug 30 15:53:06.320492 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 25/51] 10.222.0.20 () {60 vars in 1210 bytes} [Tue Aug 30 15:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:53:06.329981 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-7b906801-0cf3-41de-92f9-069e84f66304 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:06.335937 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.wsgi [None req-7b906801-0cf3-41de-92f9-069e84f66304 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-7b906801-0cf3-41de-92f9-069e84f66304 admin admin] Request method failure captured: Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Accept: application/json Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Accept-Encoding: gzip, deflate Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Connection: keep-alive Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Content-Length: 0 Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Host: 10.222.0.20 Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Openstack-Api-Version: compute 2.90 Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Openstack-System-Scope: None Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: User-Agent: python-novaclient Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Auth-Token: gAAAAABjDjJhpVe25f6CdP077O6A-WvS1QTGB95TlUv8nVym8gPcsgXHdeIuugokG7S7oEJbI81GJIBKw7zHxzkGqm-QXDqFvWhqEbodFf7QXRQ46QvkHg-jtZQu1GDcEbWfjse0RmnpjKPxrmSrUZMPW0k_S-trDL2VRNe6CSaj0lQ1jNl2Vsc Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Domain-Id: None Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Domain-Name: None Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Identity-Status: Confirmed Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Is-Admin-Project: True Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Openstack-Nova-Api-Version: 2.90 Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Domain-Id: default Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Domain-Name: Default Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Project-Name: admin Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Role: reader,admin,member Aug 30 15:53:06.337484 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Roles: reader,admin,member Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_f6954fa5b9a94855887d7068fc788d39"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant: admin Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant-Id: f6954fa5b9a94855887d7068fc788d39 Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-Tenant-Name: admin Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User: admin Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Domain-Id: default Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Domain-Name: Default Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Id: 8b9160d3cbae47a48dc9dee882da999b Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: X-User-Name: admin Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: method: > Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: exception: Flavor 451 could not be found. Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: action_args: {'id': '451'} Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:53:06.339053 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:06.339887 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: ERROR nova.api.openstack.wsgi Aug 30 15:53:06.340953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-7b906801-0cf3-41de-92f9-069e84f66304 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105484) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:53:06.342018 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-7b906801-0cf3-41de-92f9-069e84f66304 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012416 Aug 30 15:53:06.342018 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 27/52] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 30 15:53:06 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 30 15:53:07.314836 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:07.315850 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 Aug 30 15:53:07.316243 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 26/53] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:07.891476 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-ad0c12be-0e6e-4e88-a6c3-80574f6cf587 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:53:07.920638 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-ad0c12be-0e6e-4e88-a6c3-80574f6cf587 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.468956 Aug 30 15:53:07.921189 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 28/54] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 30 15:53:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:53:08.896582 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:08.897659 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001538 Aug 30 15:53:08.898063 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 27/55] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:09.468180 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-b8a25041-5bed-4506-952f-394a7d639a37 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:53:09.489182 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-b8a25041-5bed-4506-952f-394a7d639a37 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.451260 Aug 30 15:53:09.489754 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 29/56] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 30 15:53:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:53:10.470406 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:10.471442 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Aug 30 15:53:10.471833 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 28/57] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:11.023527 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-9dc59c97-54de-4ced-9023-db37dffeff58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:53:11.044063 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-9dc59c97-54de-4ced-9023-db37dffeff58 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.435124 Aug 30 15:53:11.044609 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 30/58] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 30 15:53:10 2022] POST /compute/v2.1/flavors => generated 407 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:53:12.039460 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:12.040487 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 30 15:53:12.040905 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 29/59] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:12.617016 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-8f317311-0677-492b-8112-b4a7ecac4a68 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:53:12.638450 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-8f317311-0677-492b-8112-b4a7ecac4a68 admin admin] 10.222.0.20 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.460081 Aug 30 15:53:12.639019 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 31/60] 10.222.0.20 () {64 vars in 1235 bytes} [Tue Aug 30 15:53:12 2022] POST /compute/v2.1/flavors => generated 409 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:53:13.618523 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:13.619768 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002063 Aug 30 15:53:13.620349 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 30/61] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:53:14.189501 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-6d62569d-34f3-4126-84eb-06bb894d96ab admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:53:14.211173 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-6d62569d-34f3-4126-84eb-06bb894d96ab admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.450605 Aug 30 15:53:14.211719 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 32/62] 10.222.0.20 () {60 vars in 1202 bytes} [Tue Aug 30 15:53:13 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:54:08.002535 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:08.004147 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2c70ef56-0c68-4a66-a579-2db267eda4f6 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002463 Aug 30 15:54:08.004774 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 31/63] 10.222.0.20 () {54 vars in 931 bytes} [Tue Aug 30 15:54:08 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:54:08.022896 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:08.453561 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-6da62489-d5cc-4690-b945-e8171b7c9840 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:08.474883 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-6da62489-d5cc-4690-b945-e8171b7c9840 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.459474 Aug 30 15:54:08.475440 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 33/64] 10.222.0.20 () {60 vars in 1292 bytes} [Tue Aug 30 15:54:08 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:54:08.496798 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG dbcounter [-] [105485] Writing DB stats nova_api:SELECT=14 {{(pid=105485) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:54:08.500598 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-f7f390a5-8a9a-4538-a080-19054e03d636 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:08.508666 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-f7f390a5-8a9a-4538-a080-19054e03d636 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013300 Aug 30 15:54:08.509186 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 32/65] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Aug 30 15:54:08 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:54:08.521595 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-e17efb98-4728-428d-a464-311b9924f9d9 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:08.529820 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-e17efb98-4728-428d-a464-311b9924f9d9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012211 Aug 30 15:54:08.530309 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 34/66] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Aug 30 15:54:08 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:54:08.541780 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:08.549724 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011408 Aug 30 15:54:08.550235 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 33/67] 10.222.0.20 () {60 vars in 1286 bytes} [Tue Aug 30 15:54:08 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:54:08.563738 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-fc9ba59c-5a3a-47e7-910e-acd50638078d admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:54:08.571675 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-fc9ba59c-5a3a-47e7-910e-acd50638078d admin admin] 10.222.0.20 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013498 Aug 30 15:54:08.572193 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 35/68] 10.222.0.20 () {60 vars in 1283 bytes} [Tue Aug 30 15:54:08 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:57:12.498188 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:12.499209 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001613 Aug 30 15:57:12.499597 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 34/69] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:57:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:57:12.640622 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_api:SELECT=6 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:12.811717 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:12.815315 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:12.815787 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:12.816213 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:12.816927 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:12.817398 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:12.817808 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:12.851718 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-9f4acd06-7a52-4d89-85e7-3594c4e5803e admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.213360 Aug 30 15:57:12.852285 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 36/70] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 30 15:57:12 2022] GET /compute/v2.1/os-services => generated 791 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:57:13.673869 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:13.674918 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 30 15:57:13.675321 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 35/71] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:57:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:57:13.880291 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:13.885451 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:13.885973 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:13.886382 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:13.887109 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:13.887560 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:13.887973 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:13.908134 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-74bf3342-8e28-4f82-873d-93859c618eb4 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.095110 Aug 30 15:57:13.908689 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 37/72] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 30 15:57:13 2022] GET /compute/v2.1/os-services => generated 791 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 15:57:25.147984 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:25.148985 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Aug 30 15:57:25.149409 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 36/73] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:57:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:57:25.305267 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_cell0:SELECT=4 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:25.306005 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_cell1:SELECT=4 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:25.306661 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG dbcounter [-] [105484] Writing DB stats nova_api:SELECT=8 {{(pid=105484) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:57:25.364575 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:25.368351 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:25.368825 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:25.369253 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:25.369992 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:25.370438 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:25.370849 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:25.395846 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-bb7b8903-7f3c-40d2-b64b-dbe3c137e7a1 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095857 Aug 30 15:57:25.396404 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 38/74] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 30 15:57:25 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:57:26.238612 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: DEBUG nova.api.openstack.wsgi [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] Calling method '>' {{(pid=105485) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:26.239963 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: INFO nova.api.openstack.requestlog [None req-2dc601ca-dbd5-4624-b414-7808ced512d9 admin admin] 10.222.0.20 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001526 Aug 30 15:57:26.240375 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: [pid: 105485|app: 0|req: 37/75] 10.222.0.20 () {56 vars in 1074 bytes} [Tue Aug 30 15:57:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:57:26.444898 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG nova.api.openstack.wsgi [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Calling method '>' {{(pid=105484) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:57:26.448375 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:26.448882 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:26.449347 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:26.450060 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:57:26.450511 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:57:26.450953 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: DEBUG oslo_concurrency.lockutils [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105484) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:57:26.473522 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: INFO nova.api.openstack.requestlog [None req-0ef8d6ae-8d0b-4575-a99f-f8436eafcad7 admin admin] 10.222.0.20 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095448 Aug 30 15:57:26.474077 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: [pid: 105484|app: 0|req: 39/76] 10.222.0.20 () {60 vars in 1193 bytes} [Tue Aug 30 15:57:26 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:58:22.643809 dv-cinder-855058-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 30 15:58:22.644589 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: Tue Aug 30 15:58:22 2022 - graceful shutdown triggered... Aug 30 15:58:22.645029 dv-cinder-855058-1-iscsi devstack@n-api.service[105484]: Gracefully killing worker 1 (pid: 105484)... Aug 30 15:58:22.645437 dv-cinder-855058-1-iscsi devstack@n-api.service[105485]: Gracefully killing worker 2 (pid: 105485)... Aug 30 15:58:23.646315 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: worker 1 buried after 1 seconds Aug 30 15:58:23.646315 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: worker 2 buried after 1 seconds Aug 30 15:58:23.646315 dv-cinder-855058-1-iscsi devstack@n-api.service[105483]: goodbye to uWSGI. Aug 30 15:58:23.648377 dv-cinder-855058-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 30 15:58:23.649044 dv-cinder-855058-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 30 15:58:23.652314 dv-cinder-855058-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 30 15:58:23.665092 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 30 15:58:23 2022] *** Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: nodename: dv-cinder-855058-1-iscsi Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: machine: x86_64 Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: clock source: unix Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: pcre jit disabled Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: detected number of CPU cores: 4 Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: current working directory: / Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: detected binary path: /usr/bin/uwsgi-core Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: your processes number limit is 47680 Aug 30 15:58:23.667503 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: your memory page size is 4096 bytes Aug 30 15:58:23.668502 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: detected max file descriptor number: 2048 Aug 30 15:58:23.668502 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: lock engine: pthread robust mutexes Aug 30 15:58:23.668502 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: thunder lock: enabled Aug 30 15:58:23.668502 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 30 15:58:23.668502 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 30 15:58:23.707334 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: Python main interpreter initialized at 0x561a1e4169c0 Aug 30 15:58:23.707334 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: python threads support enabled Aug 30 15:58:23.707334 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: your server socket listen backlog is limited to 100 connections Aug 30 15:58:23.707334 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: your mercy for graceful operations on workers is 90 seconds Aug 30 15:58:23.707768 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: mapped 403077 bytes (393 KB) for 2 cores Aug 30 15:58:23.707768 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: *** Operational MODE: preforking *** Aug 30 15:58:23.708036 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: *** uWSGI is running in multiple interpreter mode *** Aug 30 15:58:23.708036 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: spawned uWSGI master process (pid: 120682) Aug 30 15:58:23.708221 dv-cinder-855058-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 30 15:58:23.711022 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: spawned uWSGI worker 1 (pid: 120696, cores: 1) Aug 30 15:58:23.711022 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: spawned uWSGI worker 2 (pid: 120697, cores: 1) Aug 30 15:58:23.711022 dv-cinder-855058-1-iscsi devstack@n-api.service[120682]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 30 15:58:24.376458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 15:58:24.377116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Aug 30 15:58:25.528188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:58:25.528188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: from cryptography.utils import int_from_bytes Aug 30 15:58:25.529002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:58:25.529002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: from cryptography.utils import int_from_bytes Aug 30 15:58:25.529448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:58:25.529448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: from cryptography.utils import int_from_bytes Aug 30 15:58:25.529577 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 30 15:58:25.529577 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: from cryptography.utils import int_from_bytes Aug 30 15:58:27.912337 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:58:27.912977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:58:27.912977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:58:27.913551 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:58:27.913667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:58:27.913965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.914315 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.914611 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.914920 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.915393 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.915728 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.916045 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.916363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.916686 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.916915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.917237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.917585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-1-iscsi {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.917901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.918212 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.918483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.919026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.919328 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.919654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.919957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.920455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.920902 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.921193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.921329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 30 15:58:27.921761 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 30 15:58:27.921846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.921846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.922010 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 30 15:58:27.922136 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.922373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 30 15:58:27.922630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 30 15:58:27.922748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.923016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.923126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.923342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.923481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.923670 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.923954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.924070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.924294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.924412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-1-iscsi {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.924666 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.924782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.924993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.925103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.925316 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.925457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.925710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.925825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926285 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926384 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.926925 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-855058-1-iscsi {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927227 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927648 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.927952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.928163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.928263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.928465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.928572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.928771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.928877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.929082 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.929232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.929423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.929611 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.929749 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.929923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930039 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930638 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.930943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.931158 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.931264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.931471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.931569 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.931784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.931891 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932029 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932584 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.932901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.933068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-855058-1-iscsi {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.933207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.933410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.933562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.933722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.933826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.934032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.934151 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.934495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.934594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.934798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.934903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.935101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.935213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.935405 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.935542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.935714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.935852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936335 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936639 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.936951 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.937998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.938202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.938304 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.938520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.938612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.938825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.938928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939290 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.939980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940076 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940294 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.940948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.941109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.941211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.941454 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.941559 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.941772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.941862 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942073 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942168 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942855 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.942988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943396 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943626 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943761 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.943998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.944170 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.944299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.944475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.944592 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.944778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.944902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.945080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.945205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.945494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.945667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.945819 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.945963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.946168 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.946319 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.946461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.946611 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.946772 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.946922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.947075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.947223 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.947372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.947513 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.948704 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.948902 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.949056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.949149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.950289 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.950473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.950623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.950767 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.950865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951575 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.951996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952225 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952406 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.952955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953145 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953566 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953678 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953823 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.953930 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954100 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954492 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954720 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954898 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.954997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955182 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.955938 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.956962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.957187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.957326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.957520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.957629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.957828 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.957994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.958140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.958305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.958449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.958597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.958736 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.958883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.959029 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.959189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.959329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.959477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.959628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.959767 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.959914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.960070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.960209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.960379 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.960524 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.960664 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.960815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.960963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.961116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.961331 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.961480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.961629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.961781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.961883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.961969 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.962077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.962276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.962393 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.962579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.962683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.962880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.963002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.963181 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.963326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.963479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.963644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.963795 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.963941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.964114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.964274 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.964452 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.964615 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.964720 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.964924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.965016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.965279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.965412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 30 15:58:27.965671 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.965781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.965980 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.966087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.966290 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.966413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.966597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.966698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.966912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967356 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.967978 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.968190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.968294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.968509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.968617 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.968818 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.968918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.969124 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.969297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.969457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.969564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.969767 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.969869 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.970072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.970205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.970399 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.970490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.970710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.970801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971643 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.971955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972882 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.972973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.973185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.973299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.973529 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.973631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.973835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.973926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.974143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.974238 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.974476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.974618 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.974762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.974862 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.975086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.975221 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.975391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.975522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.975717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.975831 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976011 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976694 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.976921 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.977038 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.977206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.977378 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.977576 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.977701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.977886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978267 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978511 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978618 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.978907 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.979090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.979212 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.979414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.979532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.979737 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.979872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980014 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980130 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980324 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.980939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.981080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.981297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.981416 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.981608 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.981737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.981912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982512 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982615 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982823 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.982918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.983628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.983750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.983750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984079 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984720 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.984927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985141 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985267 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985531 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.985923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.986139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.986237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.986441 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.986591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.986739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.986845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987039 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.987979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.988146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.988303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.988992 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.989143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.989337 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.989897 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990061 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990634 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.990996 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991344 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.991848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.992059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.992175 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.992274 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.992361 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.993955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994223 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994414 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994504 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994786 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.994976 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995060 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995158 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.995913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.996127 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.996264 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.996418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.996527 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.996790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.996909 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.997099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.997190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.997428 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.997522 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.997733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.997836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998039 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998358 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998666 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.998977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.999116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.999293 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.999408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.999599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.999695 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:27.999985 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000318 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000627 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000840 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.000940 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.001153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.001280 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.001481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.001575 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.001791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.001881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.002136 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.002272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.002421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.002522 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.002741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.002848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003037 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003662 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.003968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004272 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004571 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.004983 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.005179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.005321 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.005518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.005610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.005824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.005930 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.006129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.006229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.006430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.006536 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.006740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.006887 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007044 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007144 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.007949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008256 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008869 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.008961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.009186 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.009356 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.009512 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.009613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.009816 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.009915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.010119 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.010235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.010429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.010521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.010729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.010827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.011973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.012099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.012334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.012435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.012601 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.012702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.012910 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013010 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013540 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.013941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.014153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.014246 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.014462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.014561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.014771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.014865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015168 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015382 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.015994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.016085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.016296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.016420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.016611 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.016737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.016915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017239 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017652 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.017955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.018159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.018260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.018466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.018565 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.018792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019855 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.019996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.020096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.020313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.020415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.021151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.021355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.021516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.021675 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.021818 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.021959 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.022108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.022272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.022512 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.022676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.022828 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.022977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023118 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023460 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023885 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.023885 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.024176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.024324 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.024474 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.024618 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.024767 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.024908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025276 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025528 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.025938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.026145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.026270 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.026456 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.026596 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.026761 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.026922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.027085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.027244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.027394 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.027557 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.027697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.027994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.028152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.028290 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.028394 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.028666 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.028857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.029002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.029200 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.029425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.029554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.029762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.029877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.030135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.030280 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.030414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.030571 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.030718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.030926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.031090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.031194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.031552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.031661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.031849 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.031996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032225 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032537 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032682 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.032968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033069 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033272 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033394 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033702 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.033802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034009 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.034919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035339 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035840 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.035939 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.036146 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.036344 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.036460 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.036569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.036731 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.036857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.037031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.037157 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.037361 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.037479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.037660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.037778 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.041292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.041477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.041477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.041780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.041915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042334 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042466 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042605 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.042950 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043527 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.043926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.044392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.044537 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.044663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.044791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.044933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045331 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.045989 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046125 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046261 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046512 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.046915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047304 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047431 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047557 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047691 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.047959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048100 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048748 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.048888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049024 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049161 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049719 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.049904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.050021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.050256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.050372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.050505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.050619 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.050828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051038 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.051990 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052219 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052719 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.052947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.053938 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.054937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055275 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055382 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.055865 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056081 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056221 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.056899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057027 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057116 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057354 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057586 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057715 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057812 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.057939 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058130 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058614 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.058798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.059103 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.059581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.059815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.060118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.061173 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.061516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.062477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.062790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.063238 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.063556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.063876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.064184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.064498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.064810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.065129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.065360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.065514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.065785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.066206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.066357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.066489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.066775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.066952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.067084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.067373 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.067508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.067676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.067912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.068053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.068296 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.068425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.068599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.068857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.068995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.069189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.069400 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.069531 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.069827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.069957 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.070147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.070364 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.070564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.070748 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.070886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.071164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.071296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.071578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.071722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.071889 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.072124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.072262 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.072504 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.072635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.072824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.073144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.073462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.073594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.073736 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.073866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.074165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.074409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.074731 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.074905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.075118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.075377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.075516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.075724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.075895 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.076035 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.076366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.076608 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.076755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.076971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.077124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.077411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.077603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.077733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.078030 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.078172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.078357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.078500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.078687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.078939 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.079081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.079262 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.079441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.079586 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.079863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.079991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.080168 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.080357 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.080498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.080777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.080921 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.081139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.081423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.081732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.081978 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.082118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.082321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.082471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.082641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.082944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.083092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.083260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.083438 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.083568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.083868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.084006 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.084188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.084423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.084564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.084799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.084937 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.085107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.085306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.085456 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.085725 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.085861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.086032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.086255 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.086480 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.086697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.086952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.087085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.087280 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.087453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.087594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.087900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.088077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.088218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.088518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.088649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.088844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.089008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.089148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.089503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.089643 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.089809 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.089988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.090117 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.090432 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.090579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.090735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.090944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.091082 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.091330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.091469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.091636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.091851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.091981 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.092225 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.092450 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.092591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.092830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.092973 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.093172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.093391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.093535 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.093759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.093890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.094061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.094295 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.094441 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.094655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.094799 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.094976 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.095194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.095331 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.095589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.095717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.095898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.096097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.096231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.096523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.096675 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.097019 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.097262 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.097407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.097546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.097760 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.097900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.098073 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.098258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.098396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.098679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.098815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.098994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.099303 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.099470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.099596 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.099782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.100161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.100289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.100496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.100757 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.100888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.101114 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.101300 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.101523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.101682 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.101815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.102055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.102187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.102370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.102607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.102754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.102969 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.103204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.103345 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.103593 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.103766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.103905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.104222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.104376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.104544 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.104699 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.104909 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.105074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.105205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.105492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.105635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.105803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.106223 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.106377 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.106518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.106802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.107056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.107202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.107436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.107565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.107712 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.108000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.108140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.108317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.108502 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.108632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.108925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.109053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.109307 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.109488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.109635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.109854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.110076 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.110214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.110476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.110613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.110806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.111123 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.111433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.111684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.111825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.112096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.112260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.112563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.112703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.112873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.113123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.113410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.113550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.113687 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.113849 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.114062 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.114194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.114800 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.114947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.115170 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.115313 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.115455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.115698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.115836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.116003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.116178 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.116360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.116597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.116741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.116948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.117210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.117503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.117659 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.117838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.117968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.118145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.118327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.118705 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.118847 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.119105 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.119233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.119421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.119621 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.119750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.120053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.120176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.120368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.120567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.120696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.120983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.121121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.121313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.121515 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.121723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.121986 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.122150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.122282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.122504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.122644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.122875 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.123012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.123191 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.123467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.123615 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.123787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.123915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.124095 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.124289 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.124420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.124710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.124846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.125013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.125296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.125441 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.125634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.125784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.125946 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.126169 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.126311 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.126544 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.126683 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.126850 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.127195 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.127388 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.127529 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.127762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.127893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.128050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.128333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.128480 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.128651 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.128839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.128977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137269 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137812 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.137978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138580 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138742 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138823 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.138993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139067 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.139968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140201 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140280 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140431 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140587 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140893 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.140893 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141178 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141894 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.141965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142052 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142289 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142670 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142752 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142826 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142897 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.142977 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143136 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143357 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143596 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143743 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.143965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144189 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.144696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.145058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.145172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.145292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.145380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.145461 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.145777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.146093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.146412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.146606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.146749 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.146987 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.147132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.147373 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.147643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.147832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.148027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.148296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.148440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.148616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.148863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.149036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.149209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.149398 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.149547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.149827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.149963 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.150166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.150327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.150469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.150726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.150864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.151026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.151333 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.151472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.151636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.151820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.151962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.152227 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.152456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.152606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.152835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.153036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.153173 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.153439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.153585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.153762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.153934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.154074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.154348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.154488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.154649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.154877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.155246 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.155246 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.155501 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.155631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.155864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.156017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.156157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.156361 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.156506 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.156685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.156850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.157020 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.157311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.157473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.157674 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.157962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.158091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.158263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.158526 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.158668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.158876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.159079 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.159219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.159497 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.159635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.159804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.159994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.160133 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.160426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.160560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.160734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.160917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.161057 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.161359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.161668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.161800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.161975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.162163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.162327 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.162663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.162819 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.162951 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.163222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.163355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.163537 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.163724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.163870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.164149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.164294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.164457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.164639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.164791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.165306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.165461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.165602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.165739 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.165877 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.166195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.166332 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.166332 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.166653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.166818 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.166995 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.167140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.167271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.167397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.167538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.167774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.168061 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.168202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.168400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.168640 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.168797 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.169006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.169149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.169489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.169633 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.169836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.169975 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.170150 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.170491 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.170782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.170924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.171113 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.171306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.171450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.171706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.171837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.171966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120696) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:58:28.172221 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.172735 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.173122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.173526 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.173919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.174298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.174674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.175060 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.175469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.175840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.176216 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.176782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.177163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.177566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.178188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.178567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.178968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.179346 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.179724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.180102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.180487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.180863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.181377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.181650 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.182028 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.182413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.182881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.183322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.183703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.184085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.184484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.184865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.185312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.185942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.186328 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.186702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.187083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.187521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.188152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.188646 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.189064 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.189520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.189910 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.190551 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.190959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.191402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.191814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.192216 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.192719 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.193107 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.193573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.193972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.196217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.196217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.196217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.196217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.196217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.196217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.197181 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.197181 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.197515 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.197761 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.198358 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.198788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.199180 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.199563 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.200008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.200418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.200859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.201299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.201706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.202048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.202427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.203471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.203861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.204462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.204857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.205303 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.205690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.206078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.206562 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.206988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.207380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.207774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.208266 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.208748 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.209146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.209562 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.209954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.210353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.210753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.211210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.211609 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.212007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.212529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.212907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.213410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.213798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.214192 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.214586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.215274 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.215274 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.215754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.216186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.216493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.216864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.217291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.217631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.218002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.218581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.218958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.219376 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.219750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.220125 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.220503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.220889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.221298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.221674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.222048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.222424 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.222822 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.223327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.223722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.224112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.224493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.224884 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.225312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.225721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.226112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.226503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.226881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.227314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.228011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.228011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.228599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.228991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.229409 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.229792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.230188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.230585 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.230977 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.231425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.231814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.232537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.233337 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Registered counter for database nova_api Aug 30 15:58:28.235426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.235850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.236281 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.236697 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.237260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.237658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.238055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.238586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.239085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.239823 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.240216 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.240615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.241009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.241435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.241840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.242226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.242629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.243031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.243530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.243916 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.244352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.244805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.245639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.245639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.248922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 30 15:58:28.249697 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120697) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 30 15:58:28.258547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.265691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.310387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO dbcounter [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Registered counter for database nova_api Aug 30 15:58:28.321916 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.context [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2381055-522d-452d-a836-2df87ca71581(cell1) {{(pid=120696) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 15:58:28.326000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:58:28.326476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:58:28.328019 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:58:28.328792 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:58:28.329258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:58:28.330667 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.331352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:58:28.333424 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Registered counter for database nova_cell0 Aug 30 15:58:28.337441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.337689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Registered counter for database nova_cell1 Aug 30 15:58:28.344956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.347343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.352002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.357983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.393700 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.context [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),e2381055-522d-452d-a836-2df87ca71581(cell1) {{(pid=120697) load_cells /opt/stack/nova/nova/context.py:464}} Aug 30 15:58:28.397723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:58:28.398193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:58:28.399761 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:58:28.400488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:58:28.400932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:58:28.402972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:58:28.404972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO dbcounter [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Registered counter for database nova_cell0 Aug 30 15:58:28.408982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO dbcounter [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Registered counter for database nova_cell1 Aug 30 15:58:28.416533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.418333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.424578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.425867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.501293 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO dbcounter [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Registered counter for database nova_cell0 Aug 30 15:58:28.508368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_db.sqlalchemy.engines [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120696) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.514190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writer thread running {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.570832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO dbcounter [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Registered counter for database nova_cell0 Aug 30 15:58:28.579896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_db.sqlalchemy.engines [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120697) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 30 15:58:28.584883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writer thread running {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 30 15:58:28.835871 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:58:28.843451 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:58:28.902588 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:58:28.910162 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:58:29.187277 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:58:29.193342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: WARNING keystonemiddleware.auth_token [None req-49a5b4a8-0d03-4eb9-9ee6-163d730aa5ce None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:58:29.198664 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a1e4169c0 pid: 120696 (default app) Aug 30 15:58:29.256843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 30 15:58:29.262908 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: WARNING keystonemiddleware.auth_token [None req-86de5353-ad0a-4bb7-88a1-c2c2dadae134 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 30 15:58:29.268254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561a1e4169c0 pid: 120697 (default app) Aug 30 15:59:04.980600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:04.982337 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:04.983593 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:04.985843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:05.214204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:05.216936 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:05.218173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:05.219091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:06.436545 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d957d6ea-6f01-4e8b-8363-fe48b0a4274a tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Action: 'create', calling method: .version_select at 0x7f4849046e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-350525839"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:06.697711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22cc397b-1e33-47a1-acf3-437e674d6f0e tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Action: 'create', calling method: .version_select at 0x7f4849044e50>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1596457711", "metadata": {"Type": "work"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22cc397b-1e33-47a1-acf3-437e674d6f0e tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Request method failure captured: Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 122 Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPJD5JmukKo1oTCcELOsbRLGXaxGR0FRZcHO0gsv0U-E20ntC30tXn9T0TOZSaEmvwxYYLtuemjmFmKv44a3g_Zg5E24lc-QxWSaGzuHhaiR4Km6-Inl_kla4qr1FW3m2mtFHdIQKjHH4Z1maC2XEr7cpFcl2yZm3QmulSs9nqUsfM Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:06.718368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: dc6d3706998f41db9443bcca9766ea44 Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1596457711", "metadata": {"Type": "work"}}} Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:06.720048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1596457711', 'metadata': {'Type': 'work'}}}} Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '#$%' Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:06.721042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 15:59:06.723481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 15:59:06.725640 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Aug 30 15:59:06.725640 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.726687 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22cc397b-1e33-47a1-acf3-437e674d6f0e tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:06.727901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22cc397b-1e33-47a1-acf3-437e674d6f0e tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.522483 Aug 30 15:59:06.729041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 1/1] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 30 15:59:05 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1525 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:59:06.739841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7dab27b-2248-43af-99dc-db7b30688898 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Action: 'create', calling method: .version_select at 0x7f4849015940>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-356107809", "metadata": {"Type": "work"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7dab27b-2248-43af-99dc-db7b30688898 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Request method failure captured: Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 119 Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPJD5JmukKo1oTCcELOsbRLGXaxGR0FRZcHO0gsv0U-E20ntC30tXn9T0TOZSaEmvwxYYLtuemjmFmKv44a3g_Zg5E24lc-QxWSaGzuHhaiR4Km6-Inl_kla4qr1FW3m2mtFHdIQKjHH4Z1maC2XEr7cpFcl2yZm3QmulSs9nqUsfM Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:06.744087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: dc6d3706998f41db9443bcca9766ea44 Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-356107809", "metadata": {"Type": "work"}}} Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:06.745589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-356107809', 'metadata': {'Type': 'work'}}}} Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '0' Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:06.746491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 15:59:06.747820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 15:59:06.751096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Aug 30 15:59:06.751096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.751096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f7dab27b-2248-43af-99dc-db7b30688898 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:06.751096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f7dab27b-2248-43af-99dc-db7b30688898 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010222 Aug 30 15:59:06.752870 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 2/2] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 30 15:59:06 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 18 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:59:06.760283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-243de9c6-ca9a-41df-a72c-61dcb63ec273 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Action: 'create', calling method: .version_select at 0x7f4848ef29d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1705103737", "metadata": {"Type": "work"}}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-243de9c6-ca9a-41df-a72c-61dcb63ec273 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Request method failure captured: Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 119 Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPJD5JmukKo1oTCcELOsbRLGXaxGR0FRZcHO0gsv0U-E20ntC30tXn9T0TOZSaEmvwxYYLtuemjmFmKv44a3g_Zg5E24lc-QxWSaGzuHhaiR4Km6-Inl_kla4qr1FW3m2mtFHdIQKjHH4Z1maC2XEr7cpFcl2yZm3QmulSs9nqUsfM Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:06.771897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: dc6d3706998f41db9443bcca9766ea44 Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1705103737", "metadata": {"Type": "work"}}} Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:06.773710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1705103737', 'metadata': {'Type': 'work'}}}} Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise error Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi On instance['volume']: Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi '' Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:06.774522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Aug 30 15:59:06.775816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Aug 30 15:59:06.776919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Aug 30 15:59:06.776919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:06.776919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-243de9c6-ca9a-41df-a72c-61dcb63ec273 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:06.776919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-243de9c6-ca9a-41df-a72c-61dcb63ec273 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018672 Aug 30 15:59:06.784080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 3/3] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 30 15:59:06 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 30 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 15:59:06.789465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68842df1-0df3-4237-884b-5b089ab1ee72 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Calling method '.version_select at 0x7f4848ef2700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:08.271941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-68842df1-0df3-4237-884b-5b089ab1ee72 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] HTTP exception thrown: Volume tempest-invalid-739030298 could not be found. Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68842df1-0df3-4237-884b-5b089ab1ee72 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Request method failure captured: Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-739030298 HTTP/1.1 Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPJD5JmukKo1oTCcELOsbRLGXaxGR0FRZcHO0gsv0U-E20ntC30tXn9T0TOZSaEmvwxYYLtuemjmFmKv44a3g_Zg5E24lc-QxWSaGzuHhaiR4Km6-Inl_kla4qr1FW3m2mtFHdIQKjHH4Z1maC2XEr7cpFcl2yZm3QmulSs9nqUsfM Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:08.276304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: dc6d3706998f41db9443bcca9766ea44 Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Volume tempest-invalid-739030298 could not be found. Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': 'tempest-invalid-739030298'} Aug 30 15:59:08.277938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-739030298 could not be found. (HTTP 404) (Request-ID: req-7c16afaa-1988-470b-80d3-6bb1b15ace3b) Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.278845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 15:59:08.280206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-739030298 could not be found. Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:08.281561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-739030298 could not be found. Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-739030298 could not be found. Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68842df1-0df3-4237-884b-5b089ab1ee72 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Returning 404 to user: Volume tempest-invalid-739030298 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68842df1-0df3-4237-884b-5b089ab1ee72 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/tempest-invalid-739030298" status: 404 len: 98 microversion: 2.1 time: 1.493238 Aug 30 15:59:08.282948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 4/4] 10.222.0.20 () {58 vars in 1215 bytes} [Tue Aug 30 15:59:06 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-739030298 => generated 98 bytes in 1494 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 30 15:59:08.294694 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-51601bf4-b31f-45ee-ba05-1f631ff0cc36 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008841 Aug 30 15:59:08.296754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 5/5] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Aug 30 15:59:08 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 15:59:08.307446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2e7ede18-163a-457a-ae69-c4d4f6736036 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004338 Aug 30 15:59:08.310313 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 6/6] 10.222.0.20 () {58 vars in 1137 bytes} [Tue Aug 30 15:59:08 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 30 15:59:08.321510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76e6f324-100e-487e-8239-e5ab961fb8c3 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Calling method '.version_select at 0x7f4848e55d30>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:08.576024 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d957d6ea-6f01-4e8b-8363-fe48b0a4274a tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 3.612788 Aug 30 15:59:08.578260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 1/7] 10.222.0.20 () {60 vars in 1155 bytes} [Tue Aug 30 15:59:04 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 3617 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 30 15:59:08.593331 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9a3a42f9-8fe7-43de-a7a3-7695fd816bbb tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ecaca0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:08.648109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-76e6f324-100e-487e-8239-e5ab961fb8c3 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] HTTP exception thrown: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76e6f324-100e-487e-8239-e5ab961fb8c3 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Request method failure captured: Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/os-volumes/2d45938c-e37c-419a-9221-473d56f05de1 HTTP/1.1 Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPJD5JmukKo1oTCcELOsbRLGXaxGR0FRZcHO0gsv0U-E20ntC30tXn9T0TOZSaEmvwxYYLtuemjmFmKv44a3g_Zg5E24lc-QxWSaGzuHhaiR4Km6-Inl_kla4qr1FW3m2mtFHdIQKjHH4Z1maC2XEr7cpFcl2yZm3QmulSs9nqUsfM Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:08.651121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: dc6d3706998f41db9443bcca9766ea44 Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '2d45938c-e37c-419a-9221-473d56f05de1'} Aug 30 15:59:08.652693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. (HTTP 404) (Request-ID: req-931e84c4-a913-4250-91f1-bb20acf67e1f) Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.653591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 15:59:08.657629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 15:59:08.660825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. Aug 30 15:59:08.662096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.663943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76e6f324-100e-487e-8239-e5ab961fb8c3 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Returning 404 to user: Volume 2d45938c-e37c-419a-9221-473d56f05de1 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:08.665660 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76e6f324-100e-487e-8239-e5ab961fb8c3 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2d45938c-e37c-419a-9221-473d56f05de1" status: 404 len: 109 microversion: 2.1 time: 0.348535 Aug 30 15:59:08.666787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 7/8] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 15:59:08 2022] DELETE /compute/v2.1/os-volumes/2d45938c-e37c-419a-9221-473d56f05de1 => generated 109 bytes in 350 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 15:59:08.679145 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a29070f9-a203-45b0-a552-94d914b4b699 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Calling method '.version_select at 0x7f4848eb8790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:08.795189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9a3a42f9-8fe7-43de-a7a3-7695fd816bbb tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 200 len: 344 microversion: 2.1 time: 0.205618 Aug 30 15:59:08.796234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 2/9] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 15:59:08 2022] GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 344 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 15:59:08.835384 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a29070f9-a203-45b0-a552-94d914b4b699 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] HTTP exception thrown: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a29070f9-a203-45b0-a552-94d914b4b699 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Request method failure captured: Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/os-volumes/008be6f9-1de2-4fb2-ada7-240e75be7415 HTTP/1.1 Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPJD5JmukKo1oTCcELOsbRLGXaxGR0FRZcHO0gsv0U-E20ntC30tXn9T0TOZSaEmvwxYYLtuemjmFmKv44a3g_Zg5E24lc-QxWSaGzuHhaiR4Km6-Inl_kla4qr1FW3m2mtFHdIQKjHH4Z1maC2XEr7cpFcl2yZm3QmulSs9nqUsfM Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:08.838232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ffc7b64dc9d141e08f1bc534fe456c76"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ffc7b64dc9d141e08f1bc534fe456c76 Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-753862427 Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: dc6d3706998f41db9443bcca9766ea44 Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-753862427-project Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '008be6f9-1de2-4fb2-ada7-240e75be7415'} Aug 30 15:59:08.839788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. (HTTP 404) (Request-ID: req-0cc11225-3a1b-4da3-89f9-cffcd02d80d1) Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.840709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:08.841956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 15:59:08.844724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a29070f9-a203-45b0-a552-94d914b4b699 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] Returning 404 to user: Volume 008be6f9-1de2-4fb2-ada7-240e75be7415 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a29070f9-a203-45b0-a552-94d914b4b699 tempest-VolumesNegativeTest-753862427 tempest-VolumesNegativeTest-753862427-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/008be6f9-1de2-4fb2-ada7-240e75be7415" status: 404 len: 109 microversion: 2.1 time: 0.169909 Aug 30 15:59:08.846946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 8/10] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 15:59:08 2022] GET /compute/v2.1/os-volumes/008be6f9-1de2-4fb2-ada7-240e75be7415 => generated 109 bytes in 171 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 15:59:09.813134 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-120b6ca0-563b-431b-95f1-a2d5e928858a tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ee0430>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:09.943226 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-120b6ca0-563b-431b-95f1-a2d5e928858a tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 200 len: 345 microversion: 2.1 time: 0.136010 Aug 30 15:59:09.944284 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 3/11] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 15:59:09 2022] GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 345 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:09.961723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9830103d-9e6e-43ec-88fa-234d8debb775 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Action: 'create', calling method: .version_select at 0x7f4848eb8670>, body: {"snapshot": {"volume_id": "624450a1-292f-4c67-afd9-7e6782fd6f2c", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-102975771"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:10.577349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9830103d-9e6e-43ec-88fa-234d8debb775 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.623653 Aug 30 15:59:10.578422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 9/12] 10.222.0.20 () {60 vars in 1162 bytes} [Tue Aug 30 15:59:09 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:10.588587 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4c3ae6fa-6129-4875-a506-506100c1f5c1 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ee0af0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:10.792556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4c3ae6fa-6129-4875-a506-506100c1f5c1 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 200 len: 286 microversion: 2.1 time: 0.207536 Aug 30 15:59:10.793799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 4/13] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:10 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 286 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:10.810541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1a72f3dc-742f-4789-a31b-20f96287bab2 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848de9670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:10.957861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1a72f3dc-742f-4789-a31b-20f96287bab2 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.156763 Aug 30 15:59:10.958774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 10/14] 10.222.0.20 () {58 vars in 1140 bytes} [Tue Aug 30 15:59:10 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:10.969815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8c49d60e-6299-40d6-8ef7-2c6ed8ce90fa tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ecac10>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:11.042567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8c49d60e-6299-40d6-8ef7-2c6ed8ce90fa tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 200 len: 286 microversion: 2.1 time: 0.076376 Aug 30 15:59:11.043490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 5/15] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:10 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:12.055615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-698fa86c-804e-4fb9-a413-a9f9429cf68f tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848df38b0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:12.134299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-698fa86c-804e-4fb9-a413-a9f9429cf68f tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 200 len: 286 microversion: 2.1 time: 0.082417 Aug 30 15:59:12.134946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 11/16] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:12 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 286 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:13.147368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76e95407-1102-4ef4-8e56-0b1ade8b0af8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ee0a60>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:13.223530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76e95407-1102-4ef4-8e56-0b1ade8b0af8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 200 len: 286 microversion: 2.1 time: 0.079930 Aug 30 15:59:13.229108 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 6/17] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:13 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 286 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:14.236180 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-830be3f8-1b32-402a-b34d-dcae6e2df6a7 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848de9a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:14.295165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-830be3f8-1b32-402a-b34d-dcae6e2df6a7 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 200 len: 287 microversion: 2.1 time: 0.062942 Aug 30 15:59:14.295764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 12/18] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:14 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 287 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:14.307825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d4772eb7-e1ff-4f68-8538-84a5f351110c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ee03a0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:14.443436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d4772eb7-e1ff-4f68-8538-84a5f351110c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "DELETE /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 202 len: 0 microversion: 2.1 time: 0.140414 Aug 30 15:59:14.444403 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 7/19] 10.222.0.20 () {58 vars in 1254 bytes} [Tue Aug 30 15:59:14 2022] DELETE /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:59:14.452235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a90bc8e-c1ca-44a3-9b41-de445af9e0b4 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848de9280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:14.510055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a90bc8e-c1ca-44a3-9b41-de445af9e0b4 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 200 len: 286 microversion: 2.1 time: 0.061529 Aug 30 15:59:14.511116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 13/20] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:14 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:15.522925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d17f6f72-0020-4992-b741-f429f2e5c72c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848ee0160>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:15.574872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-d17f6f72-0020-4992-b741-f429f2e5c72c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] HTTP exception thrown: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d17f6f72-0020-4992-b741-f429f2e5c72c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Request method failure captured: Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 HTTP/1.1 Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPImrqs0tBHjIR6RA0eA4Be6P4VCxSXUVS_4AHcIwMaVn0NQJOVQ9kIBrKRQh47E3M5vAZkhadEO2XI3JRT_RpN73QZhjpVxCBL7NdagUjtIMMlWCeP2FaSu-ZLLEiDB2ytI4XU_zGELKbadO13WHnTIQNkvGXj1EarkaV4k9-_9QU Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 15:59:15.578910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08146850cb014c16ada76e8252f9b149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08146850cb014c16ada76e8252f9b149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 64fe0a3ca5b34e3e9420215a24342974 Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '14ee00d7-9085-47d0-ad51-135aad7cab27'} Aug 30 15:59:15.580176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. (HTTP 404) (Request-ID: req-7fc979b3-690a-489d-9ea0-cad9508cd78b) Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.580857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:15.581793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Aug 30 15:59:15.582790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d17f6f72-0020-4992-b741-f429f2e5c72c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Returning 404 to user: Snapshot 14ee00d7-9085-47d0-ad51-135aad7cab27 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:15.583772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d17f6f72-0020-4992-b741-f429f2e5c72c tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27" status: 404 len: 111 microversion: 2.1 time: 0.061615 Aug 30 15:59:15.589322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53d56f9c-8d89-4a49-97c2-ca060ce1f783 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848e55280>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:15.596321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 8/21] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 15:59:15 2022] GET /compute/v2.1/os-snapshots/14ee00d7-9085-47d0-ad51-135aad7cab27 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:59:15.758569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53d56f9c-8d89-4a49-97c2-ca060ce1f783 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 202 len: 0 microversion: 2.1 time: 0.173034 Aug 30 15:59:15.760333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 14/22] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 15:59:15 2022] DELETE /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 15:59:15.772048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e8b41bb9-8742-47ab-987d-a581a32a6a5f tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f48498543a0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:15.939881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e8b41bb9-8742-47ab-987d-a581a32a6a5f tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 200 len: 344 microversion: 2.1 time: 0.176177 Aug 30 15:59:15.940862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 9/23] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 15:59:15 2022] GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 344 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:16.954714 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5f30933-4e40-4732-8c60-f35e708ad0a8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848eb8700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:16.996836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-c5f30933-4e40-4732-8c60-f35e708ad0a8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] HTTP exception thrown: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5f30933-4e40-4732-8c60-f35e708ad0a8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Request method failure captured: Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c HTTP/1.1 Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPImrqs0tBHjIR6RA0eA4Be6P4VCxSXUVS_4AHcIwMaVn0NQJOVQ9kIBrKRQh47E3M5vAZkhadEO2XI3JRT_RpN73QZhjpVxCBL7NdagUjtIMMlWCeP2FaSu-ZLLEiDB2ytI4XU_zGELKbadO13WHnTIQNkvGXj1EarkaV4k9-_9QU Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:16.999234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08146850cb014c16ada76e8252f9b149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08146850cb014c16ada76e8252f9b149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 64fe0a3ca5b34e3e9420215a24342974 Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '624450a1-292f-4c67-afd9-7e6782fd6f2c'} Aug 30 15:59:17.001113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. (HTTP 404) (Request-ID: req-4dcc8111-1e8d-4746-a1a6-ddfc6e975968) Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.001965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:17.003131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 15:59:17.004292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.005569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.009044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5f30933-4e40-4732-8c60-f35e708ad0a8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Returning 404 to user: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:17.009044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5f30933-4e40-4732-8c60-f35e708ad0a8 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 404 len: 109 microversion: 2.1 time: 0.058090 Aug 30 15:59:17.009044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 15/24] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 15:59:16 2022] GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:59:17.024175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efcb3c34-d40a-4e10-957f-aed564325f12 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848e30670>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:17.075129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-efcb3c34-d40a-4e10-957f-aed564325f12 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] HTTP exception thrown: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efcb3c34-d40a-4e10-957f-aed564325f12 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Request method failure captured: Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c HTTP/1.1 Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPImrqs0tBHjIR6RA0eA4Be6P4VCxSXUVS_4AHcIwMaVn0NQJOVQ9kIBrKRQh47E3M5vAZkhadEO2XI3JRT_RpN73QZhjpVxCBL7NdagUjtIMMlWCeP2FaSu-ZLLEiDB2ytI4XU_zGELKbadO13WHnTIQNkvGXj1EarkaV4k9-_9QU Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 15:59:17.077457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08146850cb014c16ada76e8252f9b149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08146850cb014c16ada76e8252f9b149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 64fe0a3ca5b34e3e9420215a24342974 Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '624450a1-292f-4c67-afd9-7e6782fd6f2c'} Aug 30 15:59:17.078649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. (HTTP 404) (Request-ID: req-2bef1708-53a2-4b0b-b843-beddb53a185f) Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.079357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._delete(loc) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Aug 30 15:59:17.080404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Aug 30 15:59:17.081458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-efcb3c34-d40a-4e10-957f-aed564325f12 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Returning 404 to user: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-efcb3c34-d40a-4e10-957f-aed564325f12 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 404 len: 109 microversion: 2.1 time: 0.058954 Aug 30 15:59:17.082898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 10/25] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 15:59:17 2022] DELETE /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 109 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 15:59:17.089599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccc1e0e4-eef8-4c22-9da7-894ce0d25566 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Calling method '.version_select at 0x7f4848e55670>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:17.134092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-ccc1e0e4-eef8-4c22-9da7-894ce0d25566 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] HTTP exception thrown: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccc1e0e4-eef8-4c22-9da7-894ce0d25566 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Request method failure captured: Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c HTTP/1.1 Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPImrqs0tBHjIR6RA0eA4Be6P4VCxSXUVS_4AHcIwMaVn0NQJOVQ9kIBrKRQh47E3M5vAZkhadEO2XI3JRT_RpN73QZhjpVxCBL7NdagUjtIMMlWCeP2FaSu-ZLLEiDB2ytI4XU_zGELKbadO13WHnTIQNkvGXj1EarkaV4k9-_9QU Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 15:59:17.136598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/08146850cb014c16ada76e8252f9b149"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/08146850cb014c16ada76e8252f9b149"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_08146850cb014c16ada76e8252f9b149"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 08146850cb014c16ada76e8252f9b149 Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1937752169 Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 64fe0a3ca5b34e3e9420215a24342974 Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1937752169-project Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '624450a1-292f-4c67-afd9-7e6782fd6f2c'} Aug 30 15:59:17.137733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. (HTTP 404) (Request-ID: req-2b5aeb4a-28fb-49d5-8677-bb00d8883b61) Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.138370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 15:59:17.139273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 15:59:17.140345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. Aug 30 15:59:17.141258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 15:59:17.142645 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ccc1e0e4-eef8-4c22-9da7-894ce0d25566 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] Returning 404 to user: Volume 624450a1-292f-4c67-afd9-7e6782fd6f2c could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 15:59:17.143603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ccc1e0e4-eef8-4c22-9da7-894ce0d25566 tempest-VolumesSnapshotsTestJSON-1937752169 tempest-VolumesSnapshotsTestJSON-1937752169-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c" status: 404 len: 109 microversion: 2.1 time: 0.057961 Aug 30 15:59:17.144312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 16/26] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 15:59:17 2022] GET /compute/v2.1/os-volumes/624450a1-292f-4c67-afd9-7e6782fd6f2c => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 15:59:19.715896 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4ed56c1e-af2b-41f3-a596-e2a07ce0aa9f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: .version_select at 0x7f4848e563a0>, body: {"keypair": {"name": "tempest-keypair-1262126823", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFo2p6tJHl91CnCXAt4MA/j2iK26458n6vU5XhxdD8SJ6PRkdfpbExXwBU/Rr6sw4tRzxrUSkGWMDIkwxeiXY2ODe4BQPLqFBfQ4by5gS0Hlilk5iilw5I2kJAQtQGJVSA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:19.857079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-4ed56c1e-af2b-41f3-a596-e2a07ce0aa9f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:19.875864 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-4ed56c1e-af2b-41f3-a596-e2a07ce0aa9f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:20.040065 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4ed56c1e-af2b-41f3-a596-e2a07ce0aa9f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.039230 Aug 30 15:59:20.040957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 11/27] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 15:59:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1041 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:20.539311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1472813607", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "networks": [{"uuid": "a88e5ef2-0734-4fac-bb31-a28275d7e29a"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:20.817021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] validate_networks() for [('a88e5ef2-0734-4fac-bb31-a28275d7e29a', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:59:24.007727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-78f9ab0b-dad9-4625-b6e3-4a7463bd8110 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'create', calling method: .version_select at 0x7f4848da8c10>, body: {"keypair": {"name": "tempest-keypair-1398166978", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPs6yAJWf/wvJvSS1Zk0Cv4wGBuKN2i1rf30yREBCdBgcuYgJCGdM2jruDP0y8JygB1yAUEAnlwwteV/EaaHBXAU/77ZB7NGdm47bCGseXmmDLw2VttHPFK6Qpgopg3IaA=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:24.094707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-78f9ab0b-dad9-4625-b6e3-4a7463bd8110 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for project 6550878193fa4088861f08552a276578. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:24.106730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-78f9ab0b-dad9-4625-b6e3-4a7463bd8110 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for user 252dd6215082420cade91b100c73f100 and project 6550878193fa4088861f08552a276578. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:24.162312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-78f9ab0b-dad9-4625-b6e3-4a7463bd8110 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.917597 Aug 30 15:59:24.171858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 12/28] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Aug 30 15:59:23 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 927 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 15:59:24.459273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-898614595", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:24.674104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] validate_networks() for [('6af5c446-333d-462f-8134-9c2082da6195', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:59:24.842597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:59:24.843089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:59:24.843910 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:59:24.844229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:59:24.844753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:59:24.876950 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:24.877486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:24.878795 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:24.883329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:24.883991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:24.886171 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:24.999781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Getting quotas for project 972006ddc9c04f1b838860912bbabe0c. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:25.047237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Getting quotas for user 096f60ad096243d3829d256db17a5f8a and project 972006ddc9c04f1b838860912bbabe0c. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:25.079293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:59:25.086796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:59:25.268753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c67f5aa5-7c4e-42fc-a59d-413745460f49 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.245955 Aug 30 15:59:25.273431 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 17/29] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 15:59:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 5253 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 15:59:25.286416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3d75238d-dad6-42e1-903b-c089f2202170 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:25.287025 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3d75238d-dad6-42e1-903b-c089f2202170 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:25.564901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3d75238d-dad6-42e1-903b-c089f2202170 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:25.604387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3d75238d-dad6-42e1-903b-c089f2202170 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1215 microversion: 2.1 time: 0.322047 Aug 30 15:59:25.613428 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 18/30] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:25 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1215 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:26.172764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1906136072", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3aa7438-61b4-41af-81a0-39b48f126de4"}], "security_groups": [{"name": "tempest-securitygroup--2045349709"}], "key_name": "tempest-keypair-1262126823", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:26.752797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] validate_networks() for [('b3aa7438-61b4-41af-81a0-39b48f126de4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:59:27.599677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:59:27.600206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:59:27.600619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:59:27.601026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:59:27.601535 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:59:27.646669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:27.647160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:27.647592 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:27.648401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:27.656074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:27.656636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:27.735597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:27.745878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for user c34836a75f144f74aa3fd6a38ccb9791 and project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:27.777920 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:59:27.789503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:59:27.930380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-38ba22be-1637-49cc-a660-405c11d3ea6e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.668994 Aug 30 15:59:27.941541 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 13/31] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 15:59:24 2022] POST /compute/v2.1/servers => generated 383 bytes in 3681 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 15:59:27.949546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:27.950164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:28.012796 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:28.018228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:28.019092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:28.020384 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:28.021053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:28.022917 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:28.773357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:28.845998 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0992c63a-ff91-4666-8725-f9e468727169 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1211 microversion: 2.1 time: 0.902621 Aug 30 15:59:28.849517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 14/32] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:27 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1211 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:28.871193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b24733f3-7a27-4d23-8375-29f55e7dd642 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:28.872485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b24733f3-7a27-4d23-8375-29f55e7dd642 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:28.914791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:59:28.918561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:59:28.919548 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:59:28.920390 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:59:28.921887 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:59:28.941183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:28.942284 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:28.942927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:28.943893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:28.944564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:28.945229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:29.058283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:29.078875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:29.103491 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b24733f3-7a27-4d23-8375-29f55e7dd642 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:29.131502 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b24733f3-7a27-4d23-8375-29f55e7dd642 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1221 microversion: 2.1 time: 0.279283 Aug 30 15:59:29.133138 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:28 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1221 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:29.164690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:59:29.190541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:59:29.357314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96b3bc17-5613-4ab5-ae8b-5dc57c699f69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.189979 Aug 30 15:59:29.367516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 15:59:26 2022] POST /compute/v2.1/servers => generated 402 bytes in 3201 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 15:59:29.371138 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51a7fc2a-fba8-40e0-a310-64771f0a7a02 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:29.371900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51a7fc2a-fba8-40e0-a310-64771f0a7a02 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:29.381471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1382600965", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:29.532153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51a7fc2a-fba8-40e0-a310-64771f0a7a02 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:29.548468 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51a7fc2a-fba8-40e0-a310-64771f0a7a02 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1242 microversion: 2.1 time: 0.180269 Aug 30 15:59:29.550585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 16/35] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:29 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1242 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:29.560244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] validate_networks() for [('6af5c446-333d-462f-8134-9c2082da6195', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:59:29.872886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:29.873705 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:29.893189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:29.893820 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:29.898553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:29.900024 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:29.902567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:29.903709 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:30.122003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:30.133554 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-aeee07d5-4042-43ea-8e52-e979a3a74b6c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1267 microversion: 2.1 time: 0.266675 Aug 30 15:59:30.153329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 17/36] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:29 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1267 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:30.331175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-695127257", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9cf09a-0cb8-4bf0-81f6-85b8ea0f47e0"}], "security_groups": [{"name": "tempest-securitygroup--51053555"}], "key_name": "tempest-keypair-1398166978", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:30.581483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] validate_networks() for [('bb9cf09a-0cb8-4bf0-81f6-85b8ea0f47e0', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 15:59:30.585902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:59:30.586441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:59:30.586903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:59:30.587377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:59:30.587847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:59:30.611020 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:30.611504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:30.611927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:30.612642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:30.613086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:30.613523 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:30.640302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:30.655722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for user c34836a75f144f74aa3fd6a38ccb9791 and project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:30.687690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:59:30.700068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:59:30.792435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a97b570-b920-46b2-8e40-049988570ec0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.416386 Aug 30 15:59:30.799446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 20/37] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 15:59:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1424 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 30 15:59:30.812509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:30.813133 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:30.842942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:30.843057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:30.843398 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:30.852126 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:30.855077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:30.855731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:31.234470 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:31.255997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17bd4b8d-5a66-48a5-8f3a-1d1f40778195 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1246 microversion: 2.1 time: 0.455013 Aug 30 15:59:31.256666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 21/38] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:30 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1246 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:31.267854 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-79b0772e-3aa0-440d-a10c-75ac3481bd94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:31.273829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-79b0772e-3aa0-440d-a10c-75ac3481bd94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:31.328699 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 15:59:31.329316 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 15:59:31.329606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 15:59:31.330010 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 15:59:31.330416 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 15:59:31.344838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:31.351029 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:31.351494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:31.352291 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:31.353058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:31.353774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:31.399464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for project 6550878193fa4088861f08552a276578. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 15:59:31.416968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-79b0772e-3aa0-440d-a10c-75ac3481bd94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:31.420796 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for user 252dd6215082420cade91b100c73f100 and project 6550878193fa4088861f08552a276578. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 15:59:31.428319 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-79b0772e-3aa0-440d-a10c-75ac3481bd94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1222 microversion: 2.1 time: 0.164111 Aug 30 15:59:31.430312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 22/39] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:31 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1222 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:31.448858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:31.450345 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 15:59:31.453189 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:31.459975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 15:59:31.479649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:31.488686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:31.488686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:31.488686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:31.488686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:31.489532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:31.561681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:31.570685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77400cbb-e9e0-495d-9d98-3d360cd73577 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1267 microversion: 2.1 time: 0.138664 Aug 30 15:59:31.571760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 23/40] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:31 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:31.579237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-964cf54b-4fd9-4ebc-bede-1c6631a2a6c4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.244805 Aug 30 15:59:31.581017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 18/41] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Aug 30 15:59:30 2022] POST /compute/v2.1/servers => generated 400 bytes in 1255 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 15:59:31.596848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f764ee40-77ce-41ec-99d4-2e7edaa92300 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:31.597713 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f764ee40-77ce-41ec-99d4-2e7edaa92300 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:31.677072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f764ee40-77ce-41ec-99d4-2e7edaa92300 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:31.684837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f764ee40-77ce-41ec-99d4-2e7edaa92300 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:31.687723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f764ee40-77ce-41ec-99d4-2e7edaa92300 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:31.689491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f764ee40-77ce-41ec-99d4-2e7edaa92300 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1281 microversion: 2.20 time: 0.097502 Aug 30 15:59:31.689985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 24/42] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:31 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1281 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:32.282835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:32.283455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:32.295636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.296139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.299582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.300330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.300802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.301250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.443298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:32.454429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:32.454876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:32.481751 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34f8ef3e-a5f4-4f03-b187-94897d91cf51 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1246 microversion: 2.1 time: 0.202752 Aug 30 15:59:32.485489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 19/43] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:32 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1246 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:32.514406 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.515119 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.035s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.515579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.516328 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.516790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.517410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.601261 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:32.601899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:32.618361 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.618873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.619312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.620027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.620479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.620900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.822693 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:32.849912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00070a0c-d5bf-405e-8d7c-eecb7d3cd062 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1285 microversion: 2.1 time: 0.247083 Aug 30 15:59:32.850562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 20/44] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:32 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1285 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:32.861131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:32.861970 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:32.882726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.893273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.893747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.895218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:32.895713 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:32.896180 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:32.909765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:32.925679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c60f7f2-3fbe-43bf-9f2f-a81974225e77 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1218 microversion: 2.1 time: 0.479040 Aug 30 15:59:32.929681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 25/45] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:32 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1218 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:33.022492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:33.039932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:33.041737 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:33.042925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-06a3ac3d-9772-4d40-a47d-cf3027d08f24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1277 microversion: 2.20 time: 0.190473 Aug 30 15:59:33.046211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 21/46] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:32 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1277 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:33.510924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:33.511169 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:33.531623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:33.534623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:33.535569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:33.538233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:33.540192 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:33.541785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:33.732377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:33.751904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-64d152a0-db3e-4059-b5ec-6ac9a7e35ee7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.247268 Aug 30 15:59:33.752872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 26/47] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:33 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:33.872900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:33.875691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:33.896355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:33.897733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:33.898397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:33.899867 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:33.901166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:33.901859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:33.953093 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:33.953769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:33.960076 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:33.960564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:33.960991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:33.969977 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:33.970497 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:33.970949 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:34.377782 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:34.380340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:34.398812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-027a7a8c-9a28-4af7-aa8e-a5c6c2017ec8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.449966 Aug 30 15:59:34.407187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 27/48] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:33 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:34.413764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:34.414382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:34.416018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dea0d9b1-d57c-450f-8fed-34070e1460ae tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1273 microversion: 2.1 time: 0.546909 Aug 30 15:59:34.416894 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 22/49] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:33 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1273 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:34.452197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:34.455223 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:34.458906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:34.459897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:34.460590 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:34.461197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:34.579030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:34.592252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:34.594443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:34.598840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2b84d9a9-b81f-413f-8857-53dcbb913c2b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.190447 Aug 30 15:59:34.618008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 28/50] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:34 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:34.773741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:34.775471 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:34.794833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:34.798358 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:34.798895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:34.799755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:34.800286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:34.802560 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:34.975977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:34.998285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ba080e2f-8c20-42a6-9765-4f657f6bf738 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.226056 Aug 30 15:59:35.013426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 23/51] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:34 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:35.421069 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:35.421889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:35.440899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:35.446884 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:35.472256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:35.473812 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:35.474194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:35.478488 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:35.478868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:35.479476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:35.480463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:35.481461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:35.482137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:35.482630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:35.483115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:35.483754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:35.838622 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:35.878010 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f619acf-2228-419a-b458-29e45d947e7c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.461357 Aug 30 15:59:35.885913 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:35 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:35.914480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:35.916282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:35.960026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:35.962447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:35.966188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:35.967735 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:35.968582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:35.969426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:35.978211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:35.997084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c39d2bf9-83b6-4c2e-86af-5877d681f15e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.550581 Aug 30 15:59:35.997888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 24/53] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:35 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:36.020430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:36.021450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:36.044176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:36.045048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:36.050421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:36.055954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:36.056546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:36.060428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:36.225239 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:36.243109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:36.245057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:36.247084 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1304ecf4-d7ae-4901-b5bd-266956b4a631 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.366048 Aug 30 15:59:36.248146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 30/54] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:35 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:36.285850 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:36.302911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f4c49a1d-0a53-407e-94ba-057369dcdb7c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.286486 Aug 30 15:59:36.323419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 25/55] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:36 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:36.908886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:36.910207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:36.919504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:36.944073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:36.944581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:36.954003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:36.954733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:36.955401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.038623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:37.039265 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:37.066853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:37.086540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:37.087207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.026s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.088198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:37.088844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:37.089450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.111915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:37.124215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3e4850a-61fe-4a5d-8535-b01006a29ac0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.227788 Aug 30 15:59:37.126562 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 31/56] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:36 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:37.271469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:37.278322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:37.289089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:37.290011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:37.290649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.291688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:37.292475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:37.294159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.356278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:37.367500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b5193794-f032-40cf-b96f-1dc97fa65ee1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.331678 Aug 30 15:59:37.381839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 26/57] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:37 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:37.393326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:37.394271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:37.413088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:37.413932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:37.414534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.415296 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:37.417754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:37.418122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:37.422806 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:37.438405 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:37.439853 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:37.440968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4143a373-c7c0-445e-86c2-40a0ef96722d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.173508 Aug 30 15:59:37.442442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 32/58] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:37 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:37.487055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:37.496264 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e5c9e7eb-d61c-4114-8f11-c3821c9db329 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.112092 Aug 30 15:59:37.497266 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:37 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:38.146531 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:38.151155 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:38.161802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.162801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.163236 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.164323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.165233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.165938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.237165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:38.248359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9473dd68-6bdd-4672-ad68-cc60488c349d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.106812 Aug 30 15:59:38.249411 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 33/60] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:38 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:38.393976 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:38.395203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:38.410176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.413843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.414797 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.424452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.429170 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.429882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.473872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:38.474476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:38.483508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.484002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.484435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.485797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.486250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.486659 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.712831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:38.728003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:38.731403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:38.734296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b1a01050-1a4f-4d71-8af1-e3e44f1c7adc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.266134 Aug 30 15:59:38.736012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 34/61] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:38 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:38.742409 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:38.743256 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:38.751534 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.752251 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.752872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.753746 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:38.754477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:38.755380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:38.894639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:38.906626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d29ec481-5094-4684-baa1-29fe63b68fc6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.165963 Aug 30 15:59:38.907532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 35/62] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:38 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:38.916878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:38.925241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5ed14b46-1dbc-45bc-8998-828cc5c402d1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.535615 Aug 30 15:59:38.925816 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 28/63] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:38 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:39.273606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:39.274191 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:39.281263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.284481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.284929 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.285665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.286118 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.286665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.363326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:39.372203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ad3e6b7-1698-49ef-81cc-c1dbf3dcbb41 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.105045 Aug 30 15:59:39.373018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 36/64] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:39 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:39.759851 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:39.760483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:39.767307 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.768048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.768747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.769455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.769900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.770310 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.841952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:39.850522 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:39.851949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:39.853054 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ad580aaf-347b-4157-815f-95050d6de970 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.097330 Aug 30 15:59:39.853691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 29/65] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:39 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:39.928955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:39.929719 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:39.937452 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.937994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.938350 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.939072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.939468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.939875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.947181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:39.948079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:39.954774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.955476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.956181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:39.956781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:39.957320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:39.957933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:40.013924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:40.026205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7a21e28-70df-4868-a0eb-429e1bce26fb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.101937 Aug 30 15:59:40.038031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 37/66] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:39 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:40.112667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:40.126606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-428e4547-70a6-4315-9fde-dcd0cf3f322c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.183440 Aug 30 15:59:40.127553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 30/67] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:39 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:40.393544 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:40.394154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:40.400913 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:40.401428 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:40.401858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:40.402560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:40.403006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:40.403415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:40.424266 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:40.472702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:40.481430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5a8c8be-9fdc-4bf9-8fbd-8b30f477cff1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.092119 Aug 30 15:59:40.482148 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 38/68] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:40 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:40.881082 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:40.884209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:40.891488 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:40.892077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:40.892582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:40.893394 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:40.893833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:40.894242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:40.959930 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:40.968607 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:40.970167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:40.971317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0eec349e-08df-441f-9ca2-cca7dff75a24 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.094368 Aug 30 15:59:40.971857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 31/69] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:40 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:41.047377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:41.047949 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:41.049900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:41.055150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:41.055629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:41.056092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:41.056771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:41.057232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:41.057652 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:41.120132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:41.132693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c8d7dbe-8a3d-4397-8e9d-115444e5bea5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.089183 Aug 30 15:59:41.133342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 39/70] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:41 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:41.152591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:41.153313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:41.159510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:41.159982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:41.160570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:41.161466 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:41.162046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:41.162599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:41.300270 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:41.304166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:41.309236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d3986ba5-6843-4a21-bf17-4b14bcf90e08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.160861 Aug 30 15:59:41.309837 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 32/71] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:41 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:41.504322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:41.505023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:41.512389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:41.513037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:41.513635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:41.514744 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:41.515597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:41.516022 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:41.601194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:41.614426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6cfeb63-2973-4b82-bc40-3843a4564177 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.114390 Aug 30 15:59:41.615040 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 40/72] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:41 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:41.993996 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:41.994600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:41.996708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:41.997407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=24 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:41.999370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:42.004628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.005121 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.005561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.006250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.006695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.007109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.080447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:42.088860 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:42.090407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:42.091505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8c74af27-e05d-4832-8183-adfb1afbf39c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.102054 Aug 30 15:59:42.092067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 33/73] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:41 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:59:42.156086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:42.156927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:42.160210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=24 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:42.161067 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:42.165816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.166418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.167137 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.168126 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.168787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.169445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.251360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:42.266310 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bcfdd3e-4e07-43dd-9a06-7add096908c4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1294 microversion: 2.1 time: 0.114180 Aug 30 15:59:42.279565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 41/74] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:42 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1294 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:42.330216 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:42.330819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:42.336779 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.337287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.337717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.338393 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.338843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.339254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.476249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:42.484415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2f604a94-f7e7-4a0d-9fb4-45c3684e6a25 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.158188 Aug 30 15:59:42.485043 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 34/75] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:42 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:42.636213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:42.636841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:42.643034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.643524 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.643937 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.644600 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:42.645036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:42.645601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:42.709823 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:42.717677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-390b699a-a57c-43be-8fc4-546e49dc97dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1274 microversion: 2.1 time: 0.085388 Aug 30 15:59:42.718237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 42/76] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:42 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1274 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:43.118188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:43.119754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:43.132252 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.134084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.134732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.137417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.139591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.140423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.287312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:43.288218 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:43.295111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.295672 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.296257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.297585 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.298180 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.298918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.320028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:43.332773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:43.340196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:43.343258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d8c88581-88bf-4a7b-8c71-e6856a6a7f1b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1333 microversion: 2.20 time: 0.232414 Aug 30 15:59:43.343853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 35/77] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:43 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1333 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:43.424353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:43.433623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15364acf-ba7d-42b5-88a4-270cb2dfc845 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1312 microversion: 2.1 time: 0.150041 Aug 30 15:59:43.434566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 43/78] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:43 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1312 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:43.505793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:43.506396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:43.512781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.513286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.513710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.514446 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.514845 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.515421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.665445 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:43.678396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a53c8925-5fd4-41f0-b6ca-40c71360950c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.176358 Aug 30 15:59:43.678978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 36/79] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:43 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:43.740591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:43.741606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:43.747951 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.748458 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.748884 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.749602 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:43.750054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:43.750447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:43.813402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:43.824880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f2cc944-1900-4624-9b24-50a720e82504 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1292 microversion: 2.1 time: 0.088685 Aug 30 15:59:43.825500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 44/80] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:43 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1292 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:44.366145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:44.366736 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:44.373156 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.373670 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.374095 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.374778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.375218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.375740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.441164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:44.449453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:44.450872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:44.452185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5f87c464-6edb-40c2-87ff-0f96263485b0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1341 microversion: 2.20 time: 0.090589 Aug 30 15:59:44.460323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 37/81] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:44 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1341 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:44.460479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:44.460479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:44.461919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.462573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.463208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.464085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.464691 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.465373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.528303 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:44.544842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e959c32-22ea-4c3e-abcc-ac63a2f6286e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1312 microversion: 2.1 time: 0.093593 Aug 30 15:59:44.545442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 45/82] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:44 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1312 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:44.700660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:44.701935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:44.708121 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.708598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.709031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.709766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.710187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.710606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.846277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:44.847120 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:44.853252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.853744 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.854172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.854853 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:44.855330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:44.855759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:44.901520 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:44.910573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-72464c43-9a28-47a0-9bdb-241b8f177a7b tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.213864 Aug 30 15:59:44.911524 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 38/83] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:44 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:44.933944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:44.941909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8811b4c9-0662-4acf-b566-d081317a5568 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1292 microversion: 2.1 time: 0.099563 Aug 30 15:59:44.942487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 46/84] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:44 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1292 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:45.475275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:45.475892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:45.482094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.482569 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:45.482992 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:45.483695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.484111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:45.484514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:45.550463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:45.558875 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:45.560314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:45.561474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-72d14702-36cf-4cec-b58f-9c5d8c6b4cd3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1341 microversion: 2.20 time: 0.090124 Aug 30 15:59:45.565963 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:45.566939 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:45.573488 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 39/85] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:45 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1341 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:45.574439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.575074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:45.575776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:45.576605 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.577187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:45.577761 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:45.646111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:45.654111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11ef0d69-4355-48d8-a3c7-26ae0930f1f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1312 microversion: 2.1 time: 0.092637 Aug 30 15:59:45.654692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 47/86] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:45 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1312 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:45.931869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:45.932480 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:45.938553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.939022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:45.939447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:45.940828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.941302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:45.942306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:45.966498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:45.967382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:45.997408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:45.997993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:46.006591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:46.008816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:46.012750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:46.014317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:46.463331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:46.472325 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2583016d-98a3-4d1b-a19c-4c59bd9b7b3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1292 microversion: 2.1 time: 0.513403 Aug 30 15:59:46.472908 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 48/87] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:45 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1292 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:46.584114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:46.585003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:46.591568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:46.592154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:46.592789 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:46.593561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:46.594185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:46.594591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:46.728001 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:46.735240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:46.737841 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-889f8ee5-65ee-45a9-897f-1eae2d2653e1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.810243 Aug 30 15:59:46.742826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 40/88] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:45 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 817 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:46.747671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:46.748219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:46.749014 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:46.749759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:46.752231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6ecdd8c8-aac4-41e2-b40d-829d8cd9d683 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1339 microversion: 2.20 time: 0.172001 Aug 30 15:59:46.753723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 49/89] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:46 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1339 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:59:46.757080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:46.757594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:46.761875 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:46.763002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:46.763714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:46.764404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:46.922568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:46.933363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-081477d5-ab8a-4e24-a8ae-3ddd6346232a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1300 microversion: 2.1 time: 0.189211 Aug 30 15:59:46.934356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 41/90] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:46 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1300 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:47.492848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:47.494617 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:47.501703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:47.502187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:47.502797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:47.503926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:47.505133 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:47.505597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:47.598569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:47.609012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-481cff13-47d5-4d66-a580-3f72899b45c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1280 microversion: 2.1 time: 0.120367 Aug 30 15:59:47.609830 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 50/91] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:47 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1280 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:47.783979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:47.788494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:47.789075 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:47.791876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:47.804942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:47.805398 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:47.807412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:47.807858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:47.809119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:47.810187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:47.810573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:47.811535 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:47.813725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:47.824787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:47.828509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:47.829313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.078690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:48.092615 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:48.095744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:48.097083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c09c8956-7731-4059-b1c2-ed1726a41d8a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1339 microversion: 2.20 time: 0.325331 Aug 30 15:59:48.098987 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 42/92] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:47 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1339 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:48.120839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:48.121798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:48.129078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.129942 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.130525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.131360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.131948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.132505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.409338 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:48.417351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7ce99f26-7b35-4549-8164-64b9b9a82508 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1300 microversion: 2.1 time: 0.317116 Aug 30 15:59:48.418172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 43/93] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:48 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1300 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:48.419503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:48.430012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bcc979ab-dc0d-4f51-88c4-4d71e52fa021 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.656660 Aug 30 15:59:48.430595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 51/94] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:47 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:48.582366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "56c87a72-8b81-47de-b08d-bd26e8cf68de", "tag": "a9caa1f2-0929-44d4-a1b3-ba5f7a7df5bf"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:48.595968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.596438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.596851 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.617874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Creating event network-changed:a9caa1f2-0929-44d4-a1b3-ba5f7a7df5bf for instance 56c87a72-8b81-47de-b08d-bd26e8cf68de on hv-cinder-85505 Aug 30 15:59:48.618385 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 15:59:48.618755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d2e1be81-849b-4ff6-8bb1-5e905cbb992f req-3328322a-d69a-49d5-9dd0-104ba62ff54b service nova] Acquired lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 15:59:48.619971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.620399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.620851 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.621704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.622142 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.622547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.631308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:48.632496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.compute.rpcapi [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 15:59:48.632639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:48.633683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] Releasing lock "compute-rpcapi-router" {{(pid=120696) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 15:59:48.639764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.640904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.641747 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.642950 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:48.643463 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:48.644075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:48.653549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd4be91c-ca1a-40d6-a751-bd750ff5cf80 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232284 Aug 30 15:59:48.657358 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 44/95] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 15:59:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:48.845836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:48.854476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-204f23ba-2e53-4f26-8311-a8db55fa18b0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.227633 Aug 30 15:59:48.855430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 52/96] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:48 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:49.123106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:49.130213 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:49.145157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.179004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.034s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.179457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.180200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.180642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.181058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.378818 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:49.394191 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:49.396319 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:49.398582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-83b1f18c-9ce3-435c-8a14-30dd8ffb7621 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1339 microversion: 2.20 time: 0.279108 Aug 30 15:59:49.399966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 45/97] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:49 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1339 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:49.445201 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:49.445655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:49.452575 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:49.453464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:49.456949 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.458613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.459069 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.459810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.460283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.462864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.463423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.463918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.464350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.465118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.468423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.469068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.827395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:49.836871 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df0df6b9-40c0-4d87-bc4e-9c7b496303b3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1300 microversion: 2.1 time: 0.396317 Aug 30 15:59:49.838879 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 53/98] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:49 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1300 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:49.876290 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:49.877089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:49.889493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.890282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.891361 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.892496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:49.893381 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:49.894302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:49.961328 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:49.971026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-996814c2-052c-42c1-b2dd-9379ceab7352 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.522952 Aug 30 15:59:49.974001 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 46/99] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:49 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 527 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 15:59:50.424814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:50.426069 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:50.452755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:50.453700 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:50.457281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:50.459342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:50.461762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:50.464252 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:50.625398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:50.633904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:50.635359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:50.636565 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fb1c0c5b-0aeb-4d30-943f-19921a7a3734 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1339 microversion: 2.20 time: 0.219437 Aug 30 15:59:50.637132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 47/100] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:50 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1339 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:50.699926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:50.710907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd73e468-e95b-4771-bda4-005d481c4f3b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.838848 Aug 30 15:59:50.726076 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 54/101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:49 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:50.861751 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:50.862680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:50.874771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:50.876360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:50.876990 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:50.877952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:50.878827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:50.879467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:50.994863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:50.995610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:51.012152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:51.013923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:51.016901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:51.021311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:51.022340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:51.024044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:51.035306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:51.654923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:51.666116 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae048289-c7fc-4b42-8387-fcc8f7bed2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.809627 Aug 30 15:59:51.666744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 48/102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:50 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:51.671823 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:51.672710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:51.680636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:51.681201 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:51.681899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:51.682674 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:51.683473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:51.684745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:51.755174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:51.763733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a140844d-c813-42ab-9d14-20daee3c7cdb tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.772843 Aug 30 15:59:51.777105 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 55/103] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:50 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:51.789812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:51.791049 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:51.801008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:51.801921 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:51.803308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:51.803308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:51.803597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:51.804391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:52.218609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:52.227209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:52.230617 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:52.232298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:52.233564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f076e801-ca18-4a4d-888a-ea15dda42b05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.565459 Aug 30 15:59:52.238425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 49/104] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:51 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:52.299489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:52.313600 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11787847-77a5-41aa-8981-dc3a09648296 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.526467 Aug 30 15:59:52.315212 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 56/105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:51 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:52.398705 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-2870dc80-c71f-40ac-96a2-c89451af5c07 req-b67de455-7bee-4b83-a6ee-acace18a0d40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8c672ab4-9099-40f4-a9ae-afc15962175d", "tag": "82b53a6b-1338-44eb-92b3-eba0281b22f0"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:52.411714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2870dc80-c71f-40ac-96a2-c89451af5c07 req-b67de455-7bee-4b83-a6ee-acace18a0d40 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:52.412496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2870dc80-c71f-40ac-96a2-c89451af5c07 req-b67de455-7bee-4b83-a6ee-acace18a0d40 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:52.413120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2870dc80-c71f-40ac-96a2-c89451af5c07 req-b67de455-7bee-4b83-a6ee-acace18a0d40 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:52.431000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-2870dc80-c71f-40ac-96a2-c89451af5c07 req-b67de455-7bee-4b83-a6ee-acace18a0d40 service nova] Creating event network-changed:82b53a6b-1338-44eb-92b3-eba0281b22f0 for instance 8c672ab4-9099-40f4-a9ae-afc15962175d on hv-cinder-85505 Aug 30 15:59:52.439161 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-2870dc80-c71f-40ac-96a2-c89451af5c07 req-b67de455-7bee-4b83-a6ee-acace18a0d40 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046251 Aug 30 15:59:52.440573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 50/106] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 15:59:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:52.689172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:52.690104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:52.701770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:52.702108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:52.702365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:52.705495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:52.706108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:52.706696 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:52.788973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:52.789716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:52.802397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:52.802893 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:52.804355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:52.805075 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:52.805600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:52.806459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:52.981773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:52.991475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63bc566c-8895-4372-a9bf-86cf28f160f0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.308443 Aug 30 15:59:52.997747 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 57/107] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:52 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:53.084735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:53.093125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e6290240-5149-420d-b870-bc101578067f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.310270 Aug 30 15:59:53.095408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 51/108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:52 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:53.248894 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d200922-337c-4f7b-afc6-6a2c2b2dc9b0", "tag": "29d214d9-d6a5-4d66-972d-16d87ca7639c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:53.260362 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:53.261032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:53.272493 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.272993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.273496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.273989 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.274400 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.275784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.278540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.279398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.280835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.316945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Creating event network-changed:29d214d9-d6a5-4d66-972d-16d87ca7639c for instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 on hv-cinder-85505 Aug 30 15:59:53.317494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:293}} Aug 30 15:59:53.317861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2a3d20dd-5fc1-46e5-86d6-5b995d4709b2 req-d2b6986a-785e-4bb3-8963-053f2f36d246 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:296}} Aug 30 15:59:53.318883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.326011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.326743 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.327931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.328561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.330826 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.358834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.compute.rpcapi [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Automatically selected compute RPC version 6.0 from minimum service version 63 Aug 30 15:59:53.360124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] Releasing lock "compute-rpcapi-router" {{(pid=120697) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:314}} Aug 30 15:59:53.397354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1bdb8c49-fad4-4650-8816-8538bbb16878 None None] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.241050 Aug 30 15:59:53.397983 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 58/109] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 15:59:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:53.406151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:53.406842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:53.417936 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.418430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.418860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.419593 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:53.420042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:53.420455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:53.676645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:53.688757 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:53.690910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:53.693302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00827b34-f5c7-46f4-bef7-aae5a8d1f6dc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.436800 Aug 30 15:59:53.704516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:53.708681 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 52/110] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:53 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 15:59:53.713912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d30de266-bd15-4e41-b8a5-725c7465237b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.314457 Aug 30 15:59:53.728011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 59/111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:53 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:54.023606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:54.024237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:54.037478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:54.039165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:54.040471 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:54.043874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:54.044860 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:54.045160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:54.116694 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:54.118057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:54.126431 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:54.126701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:54.133444 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:54.135612 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:54.141160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:54.141983 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.027129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:55.029390 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:55.039986 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a332f633-6319-490e-b6fe-8f5fbf9d2f5f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.928280 Aug 30 15:59:55.053243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 60/112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:54 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 931 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:55.053472 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-81962544-5422-4f53-a3b4-8c723c662f30 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 1.029762 Aug 30 15:59:55.053472 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 53/113] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:54 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:55.053665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-19d5bdc4-e143-4e98-984a-686519bec025 req-80b0b867-bb93-42ca-930b-9895a289d711 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9ab35a6d-8b8e-470e-8e4c-16ca84a742ac", "tag": "2bbcacc7-84dc-4397-b945-2d07bb0b8639"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:55.068844 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-19d5bdc4-e143-4e98-984a-686519bec025 req-80b0b867-bb93-42ca-930b-9895a289d711 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:55.073096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-19d5bdc4-e143-4e98-984a-686519bec025 req-80b0b867-bb93-42ca-930b-9895a289d711 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:55.074023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-19d5bdc4-e143-4e98-984a-686519bec025 req-80b0b867-bb93-42ca-930b-9895a289d711 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.074878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:55.075555 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:55.100555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-19d5bdc4-e143-4e98-984a-686519bec025 req-80b0b867-bb93-42ca-930b-9895a289d711 service nova] Creating event network-changed:2bbcacc7-84dc-4397-b945-2d07bb0b8639 for instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac on hv-cinder-85505 Aug 30 15:59:55.110514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:55.113363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:55.114242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.115959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-19d5bdc4-e143-4e98-984a-686519bec025 req-80b0b867-bb93-42ca-930b-9895a289d711 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072050 Aug 30 15:59:55.117118 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 61/114] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 15:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:55.119366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:55.119874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:55.120356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.127019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:55.128732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:55.141447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:55.141953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:55.142484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.144530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:55.145147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:55.145659 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.381105 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:55.403975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:55.407544 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:55.412271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5f8be2c4-5fa0-4c7a-8a56-46ff6c56042d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.366046 Aug 30 15:59:55.413255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 54/115] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:55 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:55.434503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:55.443651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42ad7901-1735-4144-8da9-a22c7c250f94 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.325053 Aug 30 15:59:55.444252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 62/116] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:55 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:55.446965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-73a3c161-bbcb-4796-85d0-fa26893f42cb req-13f5e896-7cad-4eeb-b52b-1817f674d5a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:55.457756 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-73a3c161-bbcb-4796-85d0-fa26893f42cb req-13f5e896-7cad-4eeb-b52b-1817f674d5a2 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:55.458433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-73a3c161-bbcb-4796-85d0-fa26893f42cb req-13f5e896-7cad-4eeb-b52b-1817f674d5a2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:55.458846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-73a3c161-bbcb-4796-85d0-fa26893f42cb req-13f5e896-7cad-4eeb-b52b-1817f674d5a2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:55.470350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-73a3c161-bbcb-4796-85d0-fa26893f42cb req-13f5e896-7cad-4eeb-b52b-1817f674d5a2 service nova] Creating event network-changed:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 15:59:55.476087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-73a3c161-bbcb-4796-85d0-fa26893f42cb req-13f5e896-7cad-4eeb-b52b-1817f674d5a2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048177 Aug 30 15:59:55.476762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 55/117] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 15:59:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:56.084017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:56.084563 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:56.085699 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:56.087223 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:56.097489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.098181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.099046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.125852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.126344 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.133711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.134765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.135926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.136629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.137852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.138464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.139056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.789981 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:56.808134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:56.824817 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc8bc599-f527-43b9-988f-1640d093b945 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.752263 Aug 30 15:59:56.837279 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 63/118] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:56 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:56.837787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2fa0be5a-d50b-4732-a11a-be6f4114da34 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.754001 Aug 30 15:59:56.837787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 56/119] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:56 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 756 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:56.837787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:56.838284 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:56.839420 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:56.844936 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:56.855508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.856000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.856430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.857131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.857606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.858023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.862404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.862886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.863474 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:56.864659 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:56.865259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:56.865819 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:57.087821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:57.097485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:57.099172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:57.100395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6805ce64-d07b-41cc-ba46-ca2cf5dd32d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.274061 Aug 30 15:59:57.101037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 64/120] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:56 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:57.103567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:57.112703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-79d9ec70-3030-4ccc-a1f0-fe1139d705c2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.280920 Aug 30 15:59:57.113870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 57/121] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:56 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:57.850745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:57.852615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:57.853500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:57.855557 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:57.868065 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:57.869033 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:57.869811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:57.870521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:57.871358 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:57.872320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:57.873780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:57.874202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:57.875423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:57.877843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:57.882067 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:57.883248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:58.215320 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:58.228055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c703d7c-ad86-447d-a18c-40b6033b7d89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.385392 Aug 30 15:59:58.232226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 65/122] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:57 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:58.240510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:58.242860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:58.255426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:58.255992 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:58.256413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:58.260685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:58.261947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:58.262496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:58.266016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:58.281649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-521f9c24-c173-4c00-a806-2fcfb0d5be12 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.434725 Aug 30 15:59:58.284329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 58/123] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:57 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:58.289458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:58.290249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:58.303987 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:58.312923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:58.317240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:58.318255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:58.318842 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:58.319269 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:58.537887 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:58.550307 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:58.551827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:58.554127 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e0de054d-b640-4ca0-bbac-da8d78edba4f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.320925 Aug 30 15:59:58.569321 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 66/124] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 15:59:58 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 15:59:58.576598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 15:59:58.590670 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5c5b86ae-e643-432a-8731-fd700fbd907a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.304456 Aug 30 15:59:58.602300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 59/125] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:58 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 15:59:58.872678 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-61b7cc53-4cf2-48d0-ae1e-7c9de1fc4dda req-8dcfc9b9-f212-432c-af09-084c7ec1b867 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c87a72-8b81-47de-b08d-bd26e8cf68de", "name": "network-vif-plugged", "status": "completed", "tag": "a9caa1f2-0929-44d4-a1b3-ba5f7a7df5bf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 15:59:58.883883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-61b7cc53-4cf2-48d0-ae1e-7c9de1fc4dda req-8dcfc9b9-f212-432c-af09-084c7ec1b867 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:58.884687 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-61b7cc53-4cf2-48d0-ae1e-7c9de1fc4dda req-8dcfc9b9-f212-432c-af09-084c7ec1b867 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:58.885455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-61b7cc53-4cf2-48d0-ae1e-7c9de1fc4dda req-8dcfc9b9-f212-432c-af09-084c7ec1b867 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:58.898963 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-61b7cc53-4cf2-48d0-ae1e-7c9de1fc4dda req-8dcfc9b9-f212-432c-af09-084c7ec1b867 service nova] Creating event network-vif-plugged:a9caa1f2-0929-44d4-a1b3-ba5f7a7df5bf for instance 56c87a72-8b81-47de-b08d-bd26e8cf68de on hv-cinder-85505 Aug 30 15:59:58.905123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-61b7cc53-4cf2-48d0-ae1e-7c9de1fc4dda req-8dcfc9b9-f212-432c-af09-084c7ec1b867 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.334238 Aug 30 15:59:58.906420 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 67/126] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 15:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 15:59:59.251891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:59.252572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:59.255351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 15:59:59.264315 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:59.265714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:59.266311 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:59.268211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:59.268976 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:59.272037 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:59.304005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 15:59:59.305520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 15:59:59.315453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:59.316194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:59.316975 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 15:59:59.320146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 15:59:59.321018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 15:59:59.322515 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:00.147675 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:00.162087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:00.169055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b75b4d7f-5dec-4bf3-81b5-ef075f97628c tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.869764 Aug 30 16:00:00.171211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b61eecb1-dc32-42a2-a550-338d2176af77 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.923521 Aug 30 16:00:00.176077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 60/127] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:59 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 929 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:00.178542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 68/128] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 15:59:59 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:00.186813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:00.190494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:00.193978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:00.194602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:00.208828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:00.210738 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:00.211742 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:00.212052 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:00.212492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:00.213202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:00.214845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:00.215672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:00.216304 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:00.217066 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:00.217939 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:00.219891 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:00.497419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:00.509910 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:00.519853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:00.521997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-314ea79f-337f-4057-ac35-84d6a14c121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.341173 Aug 30 16:00:00.533273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:00.533965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 69/129] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:00 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:00.537122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c93c84e-8bea-4d43-bea7-4020723e6266 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.357387 Aug 30 16:00:00.538649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 61/130] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:00 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:00.939335 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-90730e5e-dc63-4764-b0f6-ccf01599f21a req-18b9b539-9788-481f-a262-52488c5d3a87 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab35a6d-8b8e-470e-8e4c-16ca84a742ac", "name": "network-vif-plugged", "status": "completed", "tag": "2bbcacc7-84dc-4397-b945-2d07bb0b8639"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:00.948859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-90730e5e-dc63-4764-b0f6-ccf01599f21a req-18b9b539-9788-481f-a262-52488c5d3a87 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:00.949346 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-90730e5e-dc63-4764-b0f6-ccf01599f21a req-18b9b539-9788-481f-a262-52488c5d3a87 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:00.949766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-90730e5e-dc63-4764-b0f6-ccf01599f21a req-18b9b539-9788-481f-a262-52488c5d3a87 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:00.961980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-90730e5e-dc63-4764-b0f6-ccf01599f21a req-18b9b539-9788-481f-a262-52488c5d3a87 service nova] Creating event network-vif-plugged:2bbcacc7-84dc-4397-b945-2d07bb0b8639 for instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac on hv-cinder-85505 Aug 30 16:00:00.967159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-90730e5e-dc63-4764-b0f6-ccf01599f21a req-18b9b539-9788-481f-a262-52488c5d3a87 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032318 Aug 30 16:00:00.968482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 70/131] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:01.191840 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:01.192913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:01.202220 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:01.203431 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:01.212085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.214498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.214928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.215936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.216450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.216951 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.217916 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.218405 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.218833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.219554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.219998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.220407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.410624 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:01.427532 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cdef4f9f-1f56-41e2-8e72-43de8e80da21 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1315 microversion: 2.1 time: 0.234390 Aug 30 16:00:01.428129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 62/132] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:01 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1315 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:01.490773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:01.500091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6511cdde-99f7-412f-9bad-133772698c69 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.303699 Aug 30 16:00:01.500768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 71/133] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:01 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:01.543397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:01.544074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:01.550281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.550772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.551219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.551888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.552336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.552746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.561114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:01.562545 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:01.569469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.570831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.571607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.572477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:01.573205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:01.573813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:01.830210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:01.839734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:01.858287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:01.859946 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ace4f680-4dfb-49a6-bdf2-f764175ff249 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.320355 Aug 30 16:00:01.860304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:01.861251 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 63/134] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:01 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:01.864498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-11de9e5a-3493-45e3-988d-3c063ebd2d34 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.307035 Aug 30 16:00:01.866282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 72/135] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:01 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:02.448209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:02.448757 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:02.454777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.455246 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.455672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.456362 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.456788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.457321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.521407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:02.522440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:02.529726 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.529726 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.530489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.531304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.532532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.532944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.635766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:02.650669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a3c15b80-2af1-41c5-8aae-08f8709175b8 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1501 microversion: 2.1 time: 0.206332 Aug 30 16:00:02.651256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 64/136] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:02 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1501 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:02.694165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:02.702674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-349b9725-38d7-492e-b7f5-de433ddcbce0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.186573 Aug 30 16:00:02.703357 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 73/137] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:02 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:02.881919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:02.882519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:02.888965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.889488 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.889954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.890648 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.891227 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.891651 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.900469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:02.901547 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:02.908498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.909016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.909462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.910320 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:02.910998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:02.911555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:02.916365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:03.124634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:03.146273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bcb5a8e5-1174-441a-b8de-f40182fa60bd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.268273 Aug 30 16:00:03.146891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 65/138] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:02 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:03.184745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:03.198045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:03.198045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:03.198045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c760b333-b07c-4ce7-9841-1e3b7fed6289 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.300490 Aug 30 16:00:03.198316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 74/139] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:02 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:00:03.724389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:03.725470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:03.731585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:03.732366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:03.733058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:03.734093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:03.734676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:03.735931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:03.877990 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:03.882667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4fa64864-2f46-42f2-ac96-9f865d2a1d97 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.163115 Aug 30 16:00:03.883274 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 66/140] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:03 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:04.170522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:04.171141 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:04.173142 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:04.179065 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.179569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.180008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.181022 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.181521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.181957 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.234060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:04.234594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:04.244882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.245391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.246054 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.246727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.247162 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.247562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.357992 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:04.366529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-317b1abc-3eb9-4b15-b092-4c0d2107cc19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.201042 Aug 30 16:00:04.367189 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 75/141] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:04 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:04.371809 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7d9fef8f-ed5e-48ca-8c5e-37cf3460218f"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:04.374213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:04.380099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.380610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.381034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.381731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.382195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.382903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.404510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:04.407997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:04.413131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:04.414571 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:04.415668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ef81f2cb-50a8-4505-9410-0dc5ad424dcb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.188802 Aug 30 16:00:04.416218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 67/142] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:04 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:04.908130 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:04.909185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:04.918697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.919167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.919583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:04.920252 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:04.920692 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:04.921093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:05.049581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:05.057417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-061129f2-b144-4971-839a-7a8e3cd2b493 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.156489 Aug 30 16:00:05.057995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 68/143] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:04 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:05.387649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:05.388285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:05.394530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:05.395028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:05.395458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:05.396140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:05.396611 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:05.397000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:05.541126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:05.549672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6e7ca7a5-c727-43de-b816-40b10c3956d0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.165918 Aug 30 16:00:05.550487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 69/144] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:05 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:05.554655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:05.555245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:05.561439 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:05.562008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:05.562496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:05.563159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:05.563630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:05.564046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:05.708008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:05.716467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:05.717940 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:05.719050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cfe5658f-dd46-4ef9-a4b6-6351cd4c057d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.167880 Aug 30 16:00:05.719637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 70/145] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:05 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:06.078026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:06.078707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:06.085677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.086146 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.086570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.087237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.087675 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.088084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.222148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:06.235364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d3cd3ef8-ec41-4b67-bd4d-c9af9dc733fe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.160931 Aug 30 16:00:06.236098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 71/146] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:06 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:06.460664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d23128a0-83e9-4b8c-a674-4249f09653a5 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "POST /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.091943 Aug 30 16:00:06.461579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 76/147] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:00:04 2022] POST /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de/os-volume_attachments => generated 194 bytes in 2094 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:06.575863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:06.576616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:06.583061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.583735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.584965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.585798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.586360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.587096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.597592 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9487dbbf-14af-454c-a4e7-d4180795340f req-bbe2ad68-b92d-40ef-8bb3-5c059fb7e3d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d200922-337c-4f7b-afc6-6a2c2b2dc9b0", "name": "network-vif-plugged", "status": "completed", "tag": "29d214d9-d6a5-4d66-972d-16d87ca7639c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:06.613879 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9487dbbf-14af-454c-a4e7-d4180795340f req-bbe2ad68-b92d-40ef-8bb3-5c059fb7e3d1 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.614366 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9487dbbf-14af-454c-a4e7-d4180795340f req-bbe2ad68-b92d-40ef-8bb3-5c059fb7e3d1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.614799 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9487dbbf-14af-454c-a4e7-d4180795340f req-bbe2ad68-b92d-40ef-8bb3-5c059fb7e3d1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.636006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9487dbbf-14af-454c-a4e7-d4180795340f req-bbe2ad68-b92d-40ef-8bb3-5c059fb7e3d1 service nova] Creating event network-vif-plugged:29d214d9-d6a5-4d66-972d-16d87ca7639c for instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 on hv-cinder-85505 Aug 30 16:00:06.645422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9487dbbf-14af-454c-a4e7-d4180795340f req-bbe2ad68-b92d-40ef-8bb3-5c059fb7e3d1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053541 Aug 30 16:00:06.646108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 77/148] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:00:06.743677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:06.749834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:06.751305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:06.752937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eace0430-98db-4b10-a2c3-0a55d1f2f25c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.181114 Aug 30 16:00:06.753935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 72/149] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:06 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:06.761166 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.761925 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.762453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.763240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:06.763901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:06.764373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:06.942429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:06.952440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:06.954155 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:06.955668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01e879fc-462d-4cf3-9b90-5d25e748b878 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.217735 Aug 30 16:00:06.956227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 78/150] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:06 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:07.260230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:07.260844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:07.267220 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:07.267695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:07.268123 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:07.268805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:07.269271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:07.269684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:07.410016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:07.418589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0bd2fded-496c-40c1-a735-c15f244b297c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.162443 Aug 30 16:00:07.419220 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 73/151] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:07 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:07.775814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:07.776413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:07.783506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:07.783982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:07.784409 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:07.785089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:07.785565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:07.785986 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:07.920135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:07.928699 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa0ed6b5-4e56-4ee6-8cf3-d851d041fb08 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.157256 Aug 30 16:00:07.929284 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 79/152] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:07 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:07.978375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:07.978975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:07.985486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:07.985966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:07.986402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:07.987078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:07.987525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:07.987940 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:08.131422 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:08.140267 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:08.141753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:08.142876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9c5c3e19-6ede-4872-8402-9795372d2d91 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.168502 Aug 30 16:00:08.143595 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 74/153] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:07 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:08.439209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:08.439783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:08.445954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:08.446433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:08.446858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:08.447535 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:08.447980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:08.448395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:08.581163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:08.590365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2040bd3d-0678-4cfe-83b8-ccf43ab9a59b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.155092 Aug 30 16:00:08.591165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 80/154] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:08 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:08.668576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c672ab4-9099-40f4-a9ae-afc15962175d", "name": "network-vif-plugged", "status": "completed", "tag": "82b53a6b-1338-44eb-92b3-eba0281b22f0"}, {"server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "name": "network-vif-plugged", "status": "completed", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:08.679024 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:08.679479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:08.679909 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:08.693425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] Creating event network-vif-plugged:82b53a6b-1338-44eb-92b3-eba0281b22f0 for instance 8c672ab4-9099-40f4-a9ae-afc15962175d on hv-cinder-85505 Aug 30 16:00:08.693908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] Creating event network-vif-plugged:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 16:00:08.700962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c72f6abc-32be-422f-bfc8-ac3cc68cf20f req-840f157a-c61c-4427-96c7-77f6bca9909d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.036238 Aug 30 16:00:08.701857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 75/155] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:08.957042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:08.957959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:08.967125 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:08.967612 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:08.968041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:08.968732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:08.969179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:08.969629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:09.104721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:09.114533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98c4c9f2-0fe2-48fe-8774-6270c5e0ce67 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.166892 Aug 30 16:00:09.115331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 81/156] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:08 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:09.169625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:09.170318 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:09.176681 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:09.177163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:09.177618 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:09.178296 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:09.178772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:09.179187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:09.320550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:09.329812 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:09.331247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:09.332613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-569e2600-ccc3-49a6-b76a-7101a6f50a3c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.167436 Aug 30 16:00:09.333187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 76/157] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:09 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:09.612901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:09.613817 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:09.624273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:09.624816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:09.625248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:09.625958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:09.626403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:09.626803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:09.767411 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:09.775469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3303b3ff-bd81-4964-b309-7db99f25e849 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.167164 Aug 30 16:00:09.776049 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 82/158] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:09 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:10.135508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:10.136128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:10.142478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:10.142954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:10.143402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:10.144188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:10.144499 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:10.144920 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:10.290235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:10.298556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-af2943d5-8cb1-4553-b66d-5c2d6a2fb1f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.166976 Aug 30 16:00:10.299120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 77/159] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:10 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:10.355072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:10.355668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:10.362661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:10.363139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:10.363924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:10.364609 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:10.365056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:10.365516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:10.502582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:10.511025 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:10.512573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:10.513725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16778ecb-84c6-4e68-9f66-709686d0778a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.162750 Aug 30 16:00:10.514257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 83/160] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:10 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:10.796174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:10.796890 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:10.803168 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:10.803667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:10.804149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:10.804855 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:10.805299 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:10.805715 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:10.952448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:10.960329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b2957366-e812-4910-9c69-c26202697419 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.168296 Aug 30 16:00:10.960901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 78/161] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:10 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:11.319490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:11.320088 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:11.326682 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:11.327338 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:11.327770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:11.328462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:11.328909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:11.329363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:11.460453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:11.468153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-373c6c04-e8e1-4788-9951-3b213990ef30 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.152525 Aug 30 16:00:11.468738 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 84/162] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:11 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:11.542740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:11.543658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:11.554070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:11.554757 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:11.555469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:11.556587 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:11.557345 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:11.558181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:11.692625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:11.700914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:11.702375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:11.703502 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-07730449-97b5-4a12-b721-bf0123272cf3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.167402 Aug 30 16:00:11.704061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 79/163] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:11 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:11.983399 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:11.984198 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:11.993664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:11.994293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:11.994946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:11.995955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:11.996353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:11.996768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:12.146913 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:12.154843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a22722e4-7a26-434a-8fae-2474e20c6c2e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.176964 Aug 30 16:00:12.155435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 85/164] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:11 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:12.499585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:12.501701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:12.505995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=93 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:12.514935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:12.515552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:12.516078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:12.516846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:12.517398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:12.517876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:12.648971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:12.656807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c570419f-8f96-4355-b1f8-f46dd34eaaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.163774 Aug 30 16:00:12.657402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 80/165] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:12 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:12.729391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:12.730103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:12.732633 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=89 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:12.737986 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:12.738810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:12.739229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:12.739906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:12.740343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:12.740754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:12.879700 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:12.888088 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:12.889626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:12.890903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05f5814a-f5b9-49cf-b593-fc915c80fda4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.169074 Aug 30 16:00:12.891544 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 86/166] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:12 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:13.177376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:13.178179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:13.186735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:13.187375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:13.187941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:13.188843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:13.189481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:13.190035 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:13.325898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:13.333628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2ebf778a-c5d4-4684-a5e6-b0c9235ccb7b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1368 microversion: 2.1 time: 0.161502 Aug 30 16:00:13.334175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 81/167] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:13 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1368 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:13.677501 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:13.678118 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:13.684922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:13.685510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:13.686000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:13.686823 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:13.687232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:13.687625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:13.836462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:13.845009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b5996484-38d2-481a-83d0-ee1e5be306ee tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.171321 Aug 30 16:00:13.846411 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 87/168] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:13 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:13.912687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:13.913289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:13.919464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:13.919936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:13.920346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:13.921016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:13.921484 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:13.921915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:14.056071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:14.069434 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:14.071052 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:14.072275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bd40d297-3a63-43c2-826c-293cdf07adb1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.163443 Aug 30 16:00:14.072780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 82/169] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:13 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:14.361672 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:14.362186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:14.368960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:14.369475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:14.369904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:14.370587 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:14.371031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:14.371490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:14.501276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:14.510080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0362851-dc28-4458-8e90-dcf32e2e7739 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1558 microversion: 2.1 time: 0.152429 Aug 30 16:00:14.510635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 88/170] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:14 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:14.534351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:14.534828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:14.541189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:14.541728 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:14.542147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:14.542877 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:14.543366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:14.543774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:14.669164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3dc0d800-f040-422e-970c-60f87d224658 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.139160 Aug 30 16:00:14.669772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 83/171] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:00:14 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-interface => generated 284 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:14.870805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:14.871496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:14.892199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:14.892870 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:14.893565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:14.894625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:14.895253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:14.895908 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:15.096681 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:15.098378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:15.105359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:15.105964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:15.106476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:15.107239 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:15.107738 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:15.108154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:15.450509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:15.458408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58720b68-a749-40af-b7ac-e2b0593a7b54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.596143 Aug 30 16:00:15.458947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 89/172] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:14 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:15.544215 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:15.552745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:15.554193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:15.555292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9cb6d8cf-337e-4b2c-bfd5-c0a37a786777 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.462646 Aug 30 16:00:15.555820 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 84/173] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:15 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:16.181434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5673fcd7-156e-435f-9cb8-afa473a368b9 req-0ee9e5f1-1be7-479c-ad88-75f90835aa1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d200922-337c-4f7b-afc6-6a2c2b2dc9b0", "tag": "29d214d9-d6a5-4d66-972d-16d87ca7639c"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:16.192071 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5673fcd7-156e-435f-9cb8-afa473a368b9 req-0ee9e5f1-1be7-479c-ad88-75f90835aa1b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:16.192555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5673fcd7-156e-435f-9cb8-afa473a368b9 req-0ee9e5f1-1be7-479c-ad88-75f90835aa1b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:16.192960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5673fcd7-156e-435f-9cb8-afa473a368b9 req-0ee9e5f1-1be7-479c-ad88-75f90835aa1b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:16.197113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:16.205883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5673fcd7-156e-435f-9cb8-afa473a368b9 req-0ee9e5f1-1be7-479c-ad88-75f90835aa1b service nova] Creating event network-changed:29d214d9-d6a5-4d66-972d-16d87ca7639c for instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 on hv-cinder-85505 Aug 30 16:00:16.211067 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5673fcd7-156e-435f-9cb8-afa473a368b9 req-0ee9e5f1-1be7-479c-ad88-75f90835aa1b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033269 Aug 30 16:00:16.211654 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 90/174] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:16.479550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:16.480266 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:16.486773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:16.487257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:16.487729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:16.488745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:16.489193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:16.489658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:16.508344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:16.578475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:16.579363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:16.587082 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:16.587482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:16.587893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:16.588568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:16.589174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:16.590055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:16.641807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:16.651865 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7ef0d754-3b41-4f85-abd6-71fe57c5d960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.176091 Aug 30 16:00:16.652655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 85/175] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:16 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:16.744860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:16.753204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:16.754652 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:16.755760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1904252-37a6-489d-9bba-90371d1441ab tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.182006 Aug 30 16:00:16.756327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 91/176] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:16 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:00:17.673576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:17.674155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:17.681552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:17.682062 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:17.682494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:17.686351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:17.686819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:17.687244 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:17.778393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:17.779011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:17.785626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:17.786210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:17.786533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:17.787224 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:17.787651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:17.788234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:17.820827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:17.829243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7dbb51e4-fe2f-4da9-81b2-b20037321d99 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1322 microversion: 2.1 time: 0.159906 Aug 30 16:00:17.829974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 86/177] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:17 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1322 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:17.939931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:17.952551 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:17.954001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:17.955217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ae93e0d-0f09-45a1-8156-eee08885f6d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.180643 Aug 30 16:00:17.955756 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 92/178] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:17 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:00:18.854726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:18.855584 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:18.866071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:18.866901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:18.867572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:18.868684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:18.869580 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:18.870251 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:18.980590 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:18.981283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:18.987972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:18.988790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:18.989243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:18.989923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:18.990429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:18.990878 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:19.009401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:19.017743 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dacfdafc-c498-46d8-9d46-e68adcd17f53 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1515 microversion: 2.1 time: 0.169598 Aug 30 16:00:19.018318 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 87/179] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:18 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1515 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:19.040907 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:19.043245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:19.049326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:19.049719 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:19.050135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:19.050777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:19.051214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:19.051617 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:19.075440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lazy-loading 'flavor' on Instance uuid 8c672ab4-9099-40f4-a9ae-afc15962175d {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:00:19.127914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:19.138492 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:19.140582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:19.141817 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c0a907bb-f14f-4e78-a906-bae86f78b943 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1405 microversion: 2.20 time: 0.165458 Aug 30 16:00:19.142644 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 93/180] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:18 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:19.199543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ca5304a0-f0a6-44f4-995b-bb547c76a172 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d/action" status: 200 len: 32 microversion: 2.1 time: 0.162575 Aug 30 16:00:19.200373 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 88/181] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:00:19 2022] POST /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d/action => generated 32 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:00:19.209553 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:19.210156 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:19.216453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:19.216943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:19.217561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:19.218424 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:19.218873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:19.219287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:19.557565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:19.566492 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bb326f18-35a4-45df-8b31-d97333518a2e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.360711 Aug 30 16:00:19.567078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 94/182] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:19 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:20.170780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:20.171400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:20.177915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:20.178321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:20.178744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:20.179588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:20.180034 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:20.180448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:20.344169 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:20.353480 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:20.355086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:20.356364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-515802ee-0c64-4052-93d7-55a273a091d6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1598 microversion: 2.20 time: 0.195226 Aug 30 16:00:20.357069 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 89/183] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:00:20 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:00:20.381096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:20.382286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:20.389426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:20.390373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:20.391011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:20.391905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:20.392530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:20.392998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:20.471826 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-81aa7d53-896a-410b-a025-0d3a52ce41ea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.095728 Aug 30 16:00:20.472613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 95/184] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Aug 30 16:00:20 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:00:20.589355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:20.589964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:20.596547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:20.597036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:20.597508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:20.598233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:20.598663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:20.599132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:20.749375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:20.757523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-02f2e095-2e58-4e55-b890-2862c8cdfe93 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.172100 Aug 30 16:00:20.758091 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 90/185] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:20 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:21.780225 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:21.781057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:21.788771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:21.789252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:21.789703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:21.790378 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:21.791177 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:21.791597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:21.820835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-116d64d8-d76e-4e0a-9337-8a77ad06c4fc req-f4a6463f-81a9-4eb3-91a2-5366e17667c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:21.830859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-116d64d8-d76e-4e0a-9337-8a77ad06c4fc req-f4a6463f-81a9-4eb3-91a2-5366e17667c8 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:21.831682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-116d64d8-d76e-4e0a-9337-8a77ad06c4fc req-f4a6463f-81a9-4eb3-91a2-5366e17667c8 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:21.832296 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-116d64d8-d76e-4e0a-9337-8a77ad06c4fc req-f4a6463f-81a9-4eb3-91a2-5366e17667c8 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:21.844167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-116d64d8-d76e-4e0a-9337-8a77ad06c4fc req-f4a6463f-81a9-4eb3-91a2-5366e17667c8 service nova] Creating event network-changed:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 16:00:21.850113 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-116d64d8-d76e-4e0a-9337-8a77ad06c4fc req-f4a6463f-81a9-4eb3-91a2-5366e17667c8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032994 Aug 30 16:00:21.851272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 91/186] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:21.926520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:21.934359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-669510a5-b146-4b3a-b16f-18d54c19ccb7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.159510 Aug 30 16:00:21.935013 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 96/187] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:21 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:22.956615 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:22.957386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:22.964199 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:22.964671 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:22.965128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:22.965862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:22.966305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:22.966716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:23.100378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:23.112556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2de439df-9b3f-49fa-8963-f09f89574b6c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.160100 Aug 30 16:00:23.113828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 92/188] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:22 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:24.142159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:24.142766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:24.152494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:24.153013 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:24.153558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:24.154308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:24.154959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:24.155480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:24.309641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:24.322575 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-474ffb96-c130-4c0d-a4d2-c8baf0c08ecf tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.187775 Aug 30 16:00:24.323202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 97/189] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:24 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:25.345109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:25.346538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:25.361949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:25.362904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:25.366956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:25.367714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:25.368778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:25.370594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:25.632842 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:25.647357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-af4b54ec-b1bf-464e-85b5-e778d2e7b28c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.308049 Aug 30 16:00:25.654690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 93/190] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:25 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:26.676105 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:26.676716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:26.683350 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:26.683824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:26.684248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:26.684929 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:26.685397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:26.685812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:26.892904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:26.901586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-82746a7f-c1aa-4422-b42f-7440cb95df24 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.229802 Aug 30 16:00:26.904035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 98/191] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:26 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:26.921509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:26.922108 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:26.928263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:26.928733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:26.929345 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:26.930025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:26.930465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:26.931081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:26.961136 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:00:27.055862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-145c14d7-207b-493b-b85d-f2d425a43b97 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 204 len: 0 microversion: 2.1 time: 0.151817 Aug 30 16:00:27.056652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 94/192] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:00:26 2022] DELETE /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:00:27.065703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:27.066760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:27.073307 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:27.074350 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:27.075102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:27.076191 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:27.076870 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:27.077673 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:27.228857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:27.237717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ffa03777-5f5b-427a-8a41-ae1e3bb3d768 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1553 microversion: 2.1 time: 0.176181 Aug 30 16:00:27.238621 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 99/193] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:27 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1553 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:27.924993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:27.925572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:27.931611 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:27.932153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:27.932600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:27.933313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:27.933759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:27.934181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:28.094817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:28.103038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b7d52f7-9124-49dd-ad2c-3143b4539dd6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.182324 Aug 30 16:00:28.104017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 95/194] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:27 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:28.261017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:28.261839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:28.268735 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:28.269259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:28.269690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:28.270376 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:28.271037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:28.271454 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:28.425147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:28.433331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f244df24-cf45-4dd2-81fc-46f6ca51659d tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1553 microversion: 2.1 time: 0.177296 Aug 30 16:00:28.433897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 100/195] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:28 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1553 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:29.126619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:29.126619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:29.132540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:29.133138 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:29.133697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:29.134479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:29.135155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:29.135663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:29.278477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:29.286399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-af758182-8397-4e1a-80fa-1b18c58c03c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.166003 Aug 30 16:00:29.286970 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 96/196] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:29 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:29.455073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:29.455875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:29.462991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:29.463097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:29.463502 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:29.464425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:29.465034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:29.465558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:29.637839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:29.646801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-21455950-7401-4d60-bc32-ae59b32e2d08 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1553 microversion: 2.1 time: 0.196226 Aug 30 16:00:29.649875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 101/197] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:29 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1553 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:30.311121 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:30.312031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:30.322289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:30.323099 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:30.324085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:30.325200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:30.326034 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:30.326674 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:30.455289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:30.466487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bbf923ec-9e61-4316-a751-e03d98a497e2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.161954 Aug 30 16:00:30.467254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 97/198] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:30 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:30.668967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:30.669607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:30.676727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:30.677206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:30.677655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:30.678337 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:30.678784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:30.679193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:30.819976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:30.832918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-506a7b27-1500-4b0d-9dd5-4407c288509e tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1553 microversion: 2.1 time: 0.167619 Aug 30 16:00:30.833741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 102/199] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:30 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:31.496031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:31.496701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:31.503728 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:31.504211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:31.504643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:31.505356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:31.505806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:31.506227 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:31.639447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:31.649399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-41737ebb-117f-4e72-b2a9-870a2b3d0489 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.158540 Aug 30 16:00:31.650177 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 98/200] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:31 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:31.856658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:31.857298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:31.863795 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:31.864283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:31.864717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:31.865430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:31.865877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:31.866292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:31.999875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:32.014960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d824bc84-4e43-4506-90d5-ad903dd88869 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1553 microversion: 2.1 time: 0.162041 Aug 30 16:00:32.016504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 103/201] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:31 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:32.402066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-911879654", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:32.462760 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] validate_networks() for None {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:00:32.673196 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:32.673797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:32.692122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:32.692882 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:32.693343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:32.694045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:32.694488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:32.694901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:32.775685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:00:32.776208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:00:32.776836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:00:32.777265 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:00:32.777656 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:00:32.786983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:32.787483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:32.787905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:32.788675 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:32.789117 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:32.789549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:32.796730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:32.810948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Getting quotas for project 058ab65d5dcb4bea82fe83721c58a1c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:00:32.820836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Getting quotas for user af9f01e25ee947db9c11cc4577e980ea and project 058ab65d5dcb4bea82fe83721c58a1c6. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:00:32.833433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:00:32.836000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:00:32.870220 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:32.878882 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b87b66a3-8be2-4a18-9f62-8fb5ff31d2ff tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.209590 Aug 30 16:00:32.880560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 104/202] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:32 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:32.885177 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-909f0642-5eba-47cd-ab8f-dd6a3c956aa2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.486861 Aug 30 16:00:32.891744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 99/203] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:00:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:00:32.900829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69a83f8b-e923-4c19-bc59-babe6beb988e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:32.901402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69a83f8b-e923-4c19-bc59-babe6beb988e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:32.960183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-69a83f8b-e923-4c19-bc59-babe6beb988e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:32.967862 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69a83f8b-e923-4c19-bc59-babe6beb988e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1214 microversion: 2.1 time: 0.070716 Aug 30 16:00:32.968278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 105/204] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:32 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:33.047644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:33.048244 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:33.055622 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:33.056395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:33.056974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:33.057880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:33.058475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:33.059038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:33.203044 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:33.211688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2984f9d8-d7b6-4554-8a91-a819d8a1b736 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1553 microversion: 2.1 time: 0.168238 Aug 30 16:00:33.227529 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 100/205] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:33 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1553 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:33.305833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-83ce6db1-43ef-4249-aa1c-69c0cb3b206a req-67294555-15ff-45ce-8cb7-ace127f138e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "56c87a72-8b81-47de-b08d-bd26e8cf68de", "name": "network-vif-deleted", "tag": "a9caa1f2-0929-44d4-a1b3-ba5f7a7df5bf"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:33.316865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-83ce6db1-43ef-4249-aa1c-69c0cb3b206a req-67294555-15ff-45ce-8cb7-ace127f138e2 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:33.317398 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-83ce6db1-43ef-4249-aa1c-69c0cb3b206a req-67294555-15ff-45ce-8cb7-ace127f138e2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:33.317818 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-83ce6db1-43ef-4249-aa1c-69c0cb3b206a req-67294555-15ff-45ce-8cb7-ace127f138e2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:33.330297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-83ce6db1-43ef-4249-aa1c-69c0cb3b206a req-67294555-15ff-45ce-8cb7-ace127f138e2 service nova] Creating event network-vif-deleted:a9caa1f2-0929-44d4-a1b3-ba5f7a7df5bf for instance 56c87a72-8b81-47de-b08d-bd26e8cf68de on hv-cinder-85505 Aug 30 16:00:33.335610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-83ce6db1-43ef-4249-aa1c-69c0cb3b206a req-67294555-15ff-45ce-8cb7-ace127f138e2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033987 Aug 30 16:00:33.339881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 106/206] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:33.901497 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:33.902485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:33.910133 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:33.911277 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:33.911790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:33.912813 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:33.913547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:33.914050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:33.992868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:33.996006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:34.012402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:34.013154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:34.013794 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:34.014674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:34.015305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:34.016140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:34.061358 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:34.069883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-22d6810e-41e1-40ad-baea-d99335e00724 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.173932 Aug 30 16:00:34.070676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 101/207] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:33 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:34.098111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:34.110143 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1151087e-8c41-4e9d-a798-92b7a3302ed4 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1266 microversion: 2.1 time: 0.124182 Aug 30 16:00:34.110722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 107/208] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:33 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1266 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:34.238939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:34.240208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:34.247104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:34.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:34.248032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:34.248717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:34.249164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:34.249631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:34.284879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:34.285375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:34.285802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:34.286243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lazy-loading 'fault' on Instance uuid 56c87a72-8b81-47de-b08d-bd26e8cf68de {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:00:34.331697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '096f60ad096243d3829d256db17a5f8a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '972006ddc9c04f1b838860912bbabe0c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:34.341111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bbcb9b8c-27aa-46d0-9ee9-d2879dd50724 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 200 len: 1351 microversion: 2.1 time: 0.108055 Aug 30 16:00:34.341774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 102/209] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:34 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 1351 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:35.093516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:35.094752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:35.104035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.104679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.105419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.106464 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.106921 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.107337 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.134170 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:35.134860 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:35.144000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.144486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.144907 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.145620 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.149754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.150388 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.327580 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:35.342740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-34d8e33b-bdbf-4df2-9674-089c1476091b tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1272 microversion: 2.1 time: 0.214634 Aug 30 16:00:35.344301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 103/210] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:35 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1272 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:35.369708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:35.370363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:35.384618 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.385002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.387111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.390464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.391361 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.398064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.439804 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:35.443018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] HTTP exception thrown: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.451974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2786559d-f776-46d9-8a6c-82e9cbdae714 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.364524 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Request method failure captured: Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de HTTP/1.1 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPXp_TY71YX6z8ookbCA74ZV6rTA08V9hWjbCV2JfNLcfJNedwX6Lb17o1BH4nCkSlgKf2Znq_9g-rIIjowthtpOnui7dx-udEAlFQD8qorTMMNCISY_Mx7cDfLBPgAbQ5fqEjAgCYbXWRj6PoxUPRnGc3eRX_EZZqohUnVHRvUFe0 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:00:35.452094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 096f60ad096243d3829d256db17a5f8a Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.453309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '56c87a72-8b81-47de-b08d-bd26e8cf68de'} Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:00:35.454647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.456143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.457952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Returning 404 to user: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:00:35.457952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d8fe1066-6f23-404b-a995-4a0e8217fe7f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 404 len: 111 microversion: 2.1 time: 0.094945 Aug 30 16:00:35.459765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 104/211] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:35 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:00:35.461468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 108/212] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:35 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:35.753258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:35.755519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:35.761747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.762224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.762644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.763329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:35.763765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:35.764174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:35.778866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] HTTP exception thrown: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Request method failure captured: Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de/os-volume_attachments HTTP/1.1 Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPXp_TY71YX6z8ookbCA74ZV6rTA08V9hWjbCV2JfNLcfJNedwX6Lb17o1BH4nCkSlgKf2Znq_9g-rIIjowthtpOnui7dx-udEAlFQD8qorTMMNCISY_Mx7cDfLBPgAbQ5fqEjAgCYbXWRj6PoxUPRnGc3eRX_EZZqohUnVHRvUFe0 Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:00:35.780793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 096f60ad096243d3829d256db17a5f8a Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.782549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '56c87a72-8b81-47de-b08d-bd26e8cf68de'} Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:00:35.783449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:35.784734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:35.786912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Returning 404 to user: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:00:35.787912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f2ec4615-60d8-448c-8b1f-18d9431c36da tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038977 Aug 30 16:00:35.788626 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 105/213] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:00:35 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:00:36.369572 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:36.370876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:36.384332 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:36.388064 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:36.388722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:36.390969 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:36.392581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:36.394047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:36.439702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:36.476142 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:36.476770 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:36.484055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:36.484536 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:36.484967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:36.485740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:36.486187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:36.488584 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:36.627377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:36.643922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40fc39c1-7026-4f81-a69d-f306b62be02f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1314 microversion: 2.1 time: 0.277046 Aug 30 16:00:36.645489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 109/214] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:36 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:36.710127 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:36.718919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f47d2930-91d5-44fa-9b22-e6dc6c8372ca tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.246595 Aug 30 16:00:36.722094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 106/215] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:36 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:37.173037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c6e835d6-104a-4cd8-97bf-3e96a7c72463 req-3b2def6a-2f85-4fca-8739-0b09f3d092e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2136a7ef-9cca-4c33-8c81-a3b9de61dc15", "tag": "ba3c32b8-38d8-49d2-9de7-f7a64523f643"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:37.191018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c6e835d6-104a-4cd8-97bf-3e96a7c72463 req-3b2def6a-2f85-4fca-8739-0b09f3d092e1 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.191493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c6e835d6-104a-4cd8-97bf-3e96a7c72463 req-3b2def6a-2f85-4fca-8739-0b09f3d092e1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.191914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c6e835d6-104a-4cd8-97bf-3e96a7c72463 req-3b2def6a-2f85-4fca-8739-0b09f3d092e1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.212115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:37.212315 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c6e835d6-104a-4cd8-97bf-3e96a7c72463 req-3b2def6a-2f85-4fca-8739-0b09f3d092e1 service nova] Creating event network-changed:ba3c32b8-38d8-49d2-9de7-f7a64523f643 for instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 on hv-cinder-85505 Aug 30 16:00:37.212953 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:37.220207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.220745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.221376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.221653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c6e835d6-104a-4cd8-97bf-3e96a7c72463 req-3b2def6a-2f85-4fca-8739-0b09f3d092e1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050683 Aug 30 16:00:37.222505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.223096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.223658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.226435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 110/216] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:37.242902 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] HTTP exception thrown: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Request method failure captured: Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de HTTP/1.1 Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPXp_TY71YX6z8ookbCA74ZV6rTA08V9hWjbCV2JfNLcfJNedwX6Lb17o1BH4nCkSlgKf2Znq_9g-rIIjowthtpOnui7dx-udEAlFQD8qorTMMNCISY_Mx7cDfLBPgAbQ5fqEjAgCYbXWRj6PoxUPRnGc3eRX_EZZqohUnVHRvUFe0 Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:00:37.245107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 096f60ad096243d3829d256db17a5f8a Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.246612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '56c87a72-8b81-47de-b08d-bd26e8cf68de'} Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:00:37.247409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.248707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.251439 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Returning 404 to user: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:00:37.252446 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f5fe7b4b-0f37-4c6e-af50-f276f6d286c1 tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "DELETE /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 404 len: 111 microversion: 2.1 time: 0.044162 Aug 30 16:00:37.256366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 107/217] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:00:37 2022] DELETE /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:00:37.262139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:37.262834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] [instance: 56c87a72-8b81-47de-b08d-bd26e8cf68de] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:37.269466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.270122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.270789 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.271684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.272331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.272942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.289016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] HTTP exception thrown: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Request method failure captured: Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de HTTP/1.1 Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPXp_TY71YX6z8ookbCA74ZV6rTA08V9hWjbCV2JfNLcfJNedwX6Lb17o1BH4nCkSlgKf2Znq_9g-rIIjowthtpOnui7dx-udEAlFQD8qorTMMNCISY_Mx7cDfLBPgAbQ5fqEjAgCYbXWRj6PoxUPRnGc3eRX_EZZqohUnVHRvUFe0 Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:00:37.294086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_972006ddc9c04f1b838860912bbabe0c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 972006ddc9c04f1b838860912bbabe0c Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-DeleteServersTestJSON-1532971203 Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 096f60ad096243d3829d256db17a5f8a Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-DeleteServersTestJSON-1532971203-project Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.295291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '56c87a72-8b81-47de-b08d-bd26e8cf68de'} Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:00:37.295934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. Aug 30 16:00:37.296967 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:37.300629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] Returning 404 to user: Instance 56c87a72-8b81-47de-b08d-bd26e8cf68de could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:00:37.301997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-59a48775-b0bf-437e-926c-ad817c8fed4f tempest-DeleteServersTestJSON-1532971203 tempest-DeleteServersTestJSON-1532971203-project] 10.222.0.20 "GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de" status: 404 len: 111 microversion: 2.1 time: 0.044275 Aug 30 16:00:37.303304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 111/218] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:37 2022] GET /compute/v2.1/servers/56c87a72-8b81-47de-b08d-bd26e8cf68de => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:00:37.665722 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:37.666323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:37.679200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.679958 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.680573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.681504 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.682134 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.682727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.743662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:37.745206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:37.752093 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.752756 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.753187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:37.753906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:37.754353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:37.754770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:38.135687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:38.160364 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:38.162101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3310c4a5-9605-4356-9da3-118714324e0c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1314 microversion: 2.1 time: 0.498908 Aug 30 16:00:38.162982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 108/219] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:37 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:38.170159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23c11efe-0eb6-4ac3-9189-1e58b45fd30f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.430477 Aug 30 16:00:38.171336 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 112/220] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:37 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:39.184194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:39.184806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:39.194960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:39.195570 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:39.195876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:39.196576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:39.197813 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:39.199604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:39.203333 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:39.204195 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:39.205208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:39.205715 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:39.206154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:39.206855 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:39.215102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:39.215784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:39.594395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:39.607029 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9c0def2-1629-4958-9829-acf565d03541 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.418167 Aug 30 16:00:39.609344 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 113/221] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:39 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:39.634360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:39.657479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-19bf3d4c-92da-41cf-979e-64ac648268df tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1314 microversion: 2.1 time: 0.477209 Aug 30 16:00:39.658569 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 109/222] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:39 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1314 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:40.635657 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:40.636958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:40.655176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:40.655820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:40.656418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:40.657332 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:40.658184 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:40.658738 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:40.680452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:40.681733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:40.691455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:40.691974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:40.692381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:40.693081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:40.693555 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:40.693971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:40.982329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:40.987091 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:40.991854 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1df70bd6-c682-44da-874f-5c539ba0962e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.365770 Aug 30 16:00:40.992765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 114/223] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:40 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:41.000711 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-20faedd2-c822-4957-8b31-fd7c5e896dae tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1314 microversion: 2.1 time: 0.325862 Aug 30 16:00:41.002086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 110/224] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:40 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:42.014529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:42.015883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:42.022750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:42.024273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:42.041302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:42.041796 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:42.046472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:42.050087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:42.050371 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:42.051117 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:42.051590 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:42.052092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:42.052990 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:42.053758 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:42.054349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:42.056299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:42.744487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:42.748666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:42.761756 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e19c99be-97b5-4fa3-9d4f-4a2f0666c73e tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1314 microversion: 2.1 time: 0.742203 Aug 30 16:00:42.763511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 111/225] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:42 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1314 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:42.772777 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57a2ab2b-900f-42e1-a68d-5b604516b083 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.756220 Aug 30 16:00:42.774083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 115/226] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:42 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 765 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:42.834465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0956c8d2-4a38-44a0-8d93-a41561d72ad3 req-30e68f8d-ad8a-4ad8-82bd-830ac7e09270 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2136a7ef-9cca-4c33-8c81-a3b9de61dc15", "name": "network-vif-plugged", "status": "completed", "tag": "ba3c32b8-38d8-49d2-9de7-f7a64523f643"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:42.849350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:42.850725 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:42.852471 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=82,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:42.855278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0956c8d2-4a38-44a0-8d93-a41561d72ad3 req-30e68f8d-ad8a-4ad8-82bd-830ac7e09270 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:42.857578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0956c8d2-4a38-44a0-8d93-a41561d72ad3 req-30e68f8d-ad8a-4ad8-82bd-830ac7e09270 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:42.858264 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0956c8d2-4a38-44a0-8d93-a41561d72ad3 req-30e68f8d-ad8a-4ad8-82bd-830ac7e09270 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:42.878848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0956c8d2-4a38-44a0-8d93-a41561d72ad3 req-30e68f8d-ad8a-4ad8-82bd-830ac7e09270 service nova] Creating event network-vif-plugged:ba3c32b8-38d8-49d2-9de7-f7a64523f643 for instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 on hv-cinder-85505 Aug 30 16:00:42.886326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0956c8d2-4a38-44a0-8d93-a41561d72ad3 req-30e68f8d-ad8a-4ad8-82bd-830ac7e09270 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060564 Aug 30 16:00:42.887738 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 112/227] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:43.786549 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:43.787777 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:43.796556 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:43.798006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=62 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:43.799788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:43.800518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:43.801132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:43.801389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:43.802176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:43.803426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:43.804784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:43.806873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:43.816601 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:43.817104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:43.817553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:43.818256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:43.818696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:43.819109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:44.060148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:44.064762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:44.069873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-922102dc-ab63-4435-a711-b1445bee16d2 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.274815 Aug 30 16:00:44.072814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3f050c13-a9f0-4694-acd8-93dc8d2a680d tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1314 microversion: 2.1 time: 0.293987 Aug 30 16:00:44.075030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 116/228] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:43 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:44.082001 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 113/229] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:43 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:45.091888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:45.093079 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:45.097620 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:45.098869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:45.100727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.101393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.101978 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.102812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.103423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.103984 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.106663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.107255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.108053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.110202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.110202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.110202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.319645 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:45.336252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a0580f5-4dcf-4752-a9b2-86f1e63ad551 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.247802 Aug 30 16:00:45.337185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 117/230] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:45 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:45.338961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:45.351186 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b3a31c50-80a0-4f80-a02f-6fef346f18c7 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1464 microversion: 2.1 time: 0.258768 Aug 30 16:00:45.351770 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 114/231] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:45 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1464 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:45.406493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:45.407072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:45.413447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.414134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.414817 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.415718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.416361 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.416973 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.445369 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:00:45.619780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-57e8691d-8b02-4463-8272-bdc9669125a9 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 204 len: 0 microversion: 2.1 time: 0.217056 Aug 30 16:00:45.621721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 118/232] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:00:45 2022] DELETE /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:00:45.636829 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:45.637507 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:45.655847 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.658155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.659329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.660214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:45.661351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:45.661955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:45.826399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:45.836628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5e41a8e9-d0e6-492b-bb82-3f4f68c689b2 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1470 microversion: 2.1 time: 0.210506 Aug 30 16:00:45.837454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 115/233] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:45 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1470 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:46.362747 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:46.364454 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:46.376764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:46.377681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:46.378410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:46.379839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:46.382037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:46.382606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:46.565931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:46.575695 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40833fb7-2b05-4482-b651-36262e8563f1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.221295 Aug 30 16:00:46.576267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 119/234] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:46 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:46.859294 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:46.860795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:46.870021 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:46.870799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:46.871458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:46.872357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:46.872985 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:46.873703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:47.074243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:47.083483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ff738235-40e2-4618-92ac-47c7a7a6c53f tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1470 microversion: 2.1 time: 0.228252 Aug 30 16:00:47.084413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:46 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1470 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:47.596209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:47.597026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:47.605055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:47.606699 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:47.607142 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:47.607843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:47.608290 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:47.608700 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:47.772846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:47.782306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d1e8632-7739-429e-b9dd-12c5d5226a74 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.190088 Aug 30 16:00:47.785082 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 120/236] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:47 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:48.104707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:48.106068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:48.115362 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:48.117715 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:48.118339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:48.119205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:48.119804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:48.120388 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:48.387658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:48.401158 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ce4568f2-d3a4-4b01-bb99-3a6e48225824 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1470 microversion: 2.1 time: 0.300587 Aug 30 16:00:48.413258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 117/237] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:48 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1470 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:48.603903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9cbf6ab2-c856-40ab-bd88-439960f7517a req-d3c36bfe-a0e6-4d3d-908d-c85760959af1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2136a7ef-9cca-4c33-8c81-a3b9de61dc15", "name": "network-vif-deleted", "tag": "ba3c32b8-38d8-49d2-9de7-f7a64523f643"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:00:48.629126 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9cbf6ab2-c856-40ab-bd88-439960f7517a req-d3c36bfe-a0e6-4d3d-908d-c85760959af1 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:48.629729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9cbf6ab2-c856-40ab-bd88-439960f7517a req-d3c36bfe-a0e6-4d3d-908d-c85760959af1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:48.630226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9cbf6ab2-c856-40ab-bd88-439960f7517a req-d3c36bfe-a0e6-4d3d-908d-c85760959af1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:48.654020 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9cbf6ab2-c856-40ab-bd88-439960f7517a req-d3c36bfe-a0e6-4d3d-908d-c85760959af1 service nova] Creating event network-vif-deleted:ba3c32b8-38d8-49d2-9de7-f7a64523f643 for instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 on hv-cinder-85505 Aug 30 16:00:48.672994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9cbf6ab2-c856-40ab-bd88-439960f7517a req-d3c36bfe-a0e6-4d3d-908d-c85760959af1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.067084 Aug 30 16:00:48.672994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 121/238] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:00:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:00:48.805124 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:48.806041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:48.817931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:48.818653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:48.819292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:48.820163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:48.820916 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:48.821382 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:49.033653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:49.038023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:49.044792 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d5ad467-4941-4720-b26c-4c0468d27925 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.244249 Aug 30 16:00:49.046329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 118/239] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:48 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:49.427626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:49.428619 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:49.434790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:49.435469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:49.435976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:49.437211 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:49.437950 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:49.438547 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:49.476377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:49.477703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:49.478261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:49.478841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lazy-loading 'fault' on Instance uuid 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:00:49.552232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'af9f01e25ee947db9c11cc4577e980ea', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '058ab65d5dcb4bea82fe83721c58a1c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:49.565102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f47e0558-13b8-4a77-8d4b-87cf079e3088 tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 200 len: 1304 microversion: 2.1 time: 0.142220 Aug 30 16:00:49.570108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 122/240] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:49 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 1304 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:50.072447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:50.073000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:50.080663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:50.081141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:50.081807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:50.082428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:50.082871 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:50.083322 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:50.226348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:50.234800 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-83508126-b931-4177-98ed-bad00da3a086 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.168461 Aug 30 16:00:50.235622 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 119/241] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:50 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:50.590685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:50.591293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] [instance: 2136a7ef-9cca-4c33-8c81-a3b9de61dc15] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:50.598232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:50.598813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:50.599242 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:50.599934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:50.600872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:50.601329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:50.778614 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] HTTP exception thrown: Instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 could not be found. Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Request method failure captured: Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 HTTP/1.1 Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjQd1XCRpSM1GuBtgCLx0WOA4GrzpIa1vt6KB6aeLZd-Jlur6RPM6HbheIFtRIu4j4NwdFvJwmw4nYsGtPc6DncbA8LBj4dL_--sm-lLdzH8dq67uJdVVXDBBp8iLJ6lNyV3H9NICReSQ1NbFXGM2PJzFBC0_HEF_lAH6Yu8-QxJNoM Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 058ab65d5dcb4bea82fe83721c58a1c6 Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesNegativeTest-1222081593 Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:00:50.780408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/058ab65d5dcb4bea82fe83721c58a1c6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/058ab65d5dcb4bea82fe83721c58a1c6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/058ab65d5dcb4bea82fe83721c58a1c6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_058ab65d5dcb4bea82fe83721c58a1c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesNegativeTest-1222081593 Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 058ab65d5dcb4bea82fe83721c58a1c6 Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesNegativeTest-1222081593 Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesNegativeTest-1222081593-project Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: af9f01e25ee947db9c11cc4577e980ea Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesNegativeTest-1222081593-project Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 could not be found. Aug 30 16:00:50.782063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '2136a7ef-9cca-4c33-8c81-a3b9de61dc15'} Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 could not be found. Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:00:50.787932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 could not be found. Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 could not be found. Aug 30 16:00:50.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:00:50.790448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] Returning 404 to user: Instance 2136a7ef-9cca-4c33-8c81-a3b9de61dc15 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:00:50.790448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbf5d093-7cb7-499d-a0ec-1c887672726c tempest-VolumesNegativeTest-1222081593 tempest-VolumesNegativeTest-1222081593-project] 10.222.0.20 "GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15" status: 404 len: 111 microversion: 2.1 time: 0.195016 Aug 30 16:00:50.790448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 123/242] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:50 2022] GET /compute/v2.1/servers/2136a7ef-9cca-4c33-8c81-a3b9de61dc15 => generated 111 bytes in 196 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:00:51.261482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:51.262642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:51.275192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:51.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:51.276422 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:51.277412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:51.278049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:51.278717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:51.456404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:51.464490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-76ab1944-4809-4547-8c96-a7191c62e380 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.208342 Aug 30 16:00:51.465256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 120/243] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:51 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:52.487306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:52.488965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:52.496065 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:52.496739 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:52.497397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:52.498298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:52.499099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:52.499990 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:52.730023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:52.739178 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2abffaf-a4dc-4d11-bf75-dc41ad98e467 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.257746 Aug 30 16:00:52.739732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 124/244] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:52 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:00:53.761254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:53.761876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:53.771074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:53.772483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:53.772978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:53.773839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:53.777626 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:53.778440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:54.064599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:54.077761 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd94c3d5-0392-4b3e-bddc-0120bb458bf7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.321099 Aug 30 16:00:54.092981 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 121/245] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:53 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:55.120128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:55.120729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:55.128047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:55.128785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:55.129796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:55.130798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:55.131306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:55.131801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:55.363267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:55.371810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-76e9e275-52b8-41e9-969f-3ce3b3293c17 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.255736 Aug 30 16:00:55.372387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 125/246] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:55 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:56.395935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:56.398890 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:56.408557 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:56.409418 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:56.410140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:56.410994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:56.411585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:56.412346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:56.603499 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:56.611851 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1cf214a2-83a7-454e-b64c-7c3117b13911 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.222978 Aug 30 16:00:56.613390 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 122/247] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:56 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:57.633906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:57.634750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:57.642559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:57.643096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:57.643607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:57.644360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:57.644902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:57.645413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:57.783433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:57.787090 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:00:57.792059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-81d3cdad-8ac0-4e64-8a52-821c06e90ec9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.162204 Aug 30 16:00:57.792639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 126/248] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:57 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:00:58.815168 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:00:58.815768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:00:58.824635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:58.825036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:58.825486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:58.826381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:00:58.826824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:00:58.827231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:00:58.966539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:00:58.974912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7770d0fe-80a1-400e-9480-d46d672ceaa6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.164966 Aug 30 16:00:58.977698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 123/249] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:58 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:00.005613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:00.006230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:00.015084 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:00.015558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:00.016054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:00.016764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:00.017226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:00.017657 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:00.213900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:00.226560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7dbb6e47-46d5-46c7-9565-d1feef6b7e1f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.231245 Aug 30 16:01:00.227213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 127/250] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:00:59 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:00.395661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-327757058", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "networks": [{"uuid": "d84bf345-feb7-4272-923c-4d088bd34594"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:00.481619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] validate_networks() for [('d84bf345-feb7-4272-923c-4d088bd34594', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:01:00.956679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:01:00.957370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:01:00.957828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:01:00.958401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:01:00.958801 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:01:00.967926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:00.968408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:00.968835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:00.969640 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:00.970085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:00.970506 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:00.987126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Getting quotas for project 80493f357d57418cb58f8a33e82b8822. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:00.991905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Getting quotas for user e9fdf5c5f263474bb41ab41bdac6f78f and project 80493f357d57418cb58f8a33e82b8822. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:01.004363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:01:01.006705 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:01:01.059334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8715fba3-9a13-4d66-ac84-f558de852622 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670517 Aug 30 16:01:01.060275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 124/251] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:01:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:01:01.071211 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b8841247-3081-4f9e-8843-10432afe1fab tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:01.072441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b8841247-3081-4f9e-8843-10432afe1fab tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:01.140746 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b8841247-3081-4f9e-8843-10432afe1fab tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:01.148557 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b8841247-3081-4f9e-8843-10432afe1fab tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1213 microversion: 2.1 time: 0.081314 Aug 30 16:01:01.149601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 128/252] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:01 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1213 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:01.255324 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:01.256411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:01.264708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:01.265271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:01.265928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:01.266923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:01.267567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:01.268166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:01.436695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:01.445478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ecf14cbd-08e7-4840-8fd0-1cf0487d82cc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.195818 Aug 30 16:01:01.446563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 125/253] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:01 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:02.170541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:02.171155 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:02.180570 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:02.181089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:02.181593 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:02.182299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:02.182752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:02.183176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:02.252476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:02.260292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48c6851f-edd1-486e-875b-6be79133824a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1209 microversion: 2.1 time: 0.093863 Aug 30 16:01:02.260903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 129/254] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:02 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1209 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:02.467448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:02.468233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:02.476679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:02.477347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:02.478160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:02.485853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:02.486400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:02.486830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:02.645485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:02.655305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7585bba4-c25c-4563-8d7a-b5d72576fcb3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.191634 Aug 30 16:01:02.656023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 126/255] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:02 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:02.958567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:02.959046 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:02.965258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:02.965749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:02.966159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:02.966856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:02.967266 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:02.967867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:02.992401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e37e4200-616f-4fe4-b021-d037c3f302cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/ips" status: 200 len: 150 microversion: 2.1 time: 0.037305 Aug 30 16:01:02.992635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 130/256] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:01:02 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:03.282657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:03.283461 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:03.294922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:03.295652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:03.296265 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:03.297229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:03.297915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:03.298520 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:03.392128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:03.402080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cdd1c76c-cdd9-4efd-969e-c7e9babc2e61 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1265 microversion: 2.1 time: 0.123990 Aug 30 16:01:03.402815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 127/257] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:03 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:03.676410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:03.676933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:03.683701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:03.684300 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:03.684729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:03.685448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:03.685874 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:03.686286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:03.816116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:03.823946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e6d2ddf8-0315-438c-a7b3-5c521d09bf5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1521 microversion: 2.1 time: 0.151728 Aug 30 16:01:03.824502 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 131/258] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:03 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:04.421236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a06f2d1-c8d4-45db-b957-c87d2f66abe7"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:04.423326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:04.423935 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:04.424072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:04.430268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:04.430942 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:04.431117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:04.431560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:04.432048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:04.432273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:04.433459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:04.433570 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:04.434078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:04.434693 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:04.435159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:04.435578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:04.518189 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:04.526225 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b74091cd-2bcf-4c1a-9049-d3e40d93d9e3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1273 microversion: 2.1 time: 0.106723 Aug 30 16:01:04.527410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 132/259] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:04 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1273 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:04.844102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:04.845427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:04.854345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:04.854870 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:04.855278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:04.856099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:04.856434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:04.856859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:04.959634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-36dfd5e4-0d87-4858-b225-d3643fbd580c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.543053 Aug 30 16:01:04.960731 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 128/260] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:01:04 2022] POST /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments => generated 194 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:05.040115 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:05.049619 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-818fc2be-f666-4558-a724-e38746b8eb54 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1501 microversion: 2.1 time: 0.209462 Aug 30 16:01:05.050194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 133/261] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:04 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1501 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:05.072049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:05.072839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:05.079977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:05.080698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:05.081249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:05.082077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:05.082783 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:05.083507 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:05.226457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:05.234235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00245e81-ba5b-4961-9cd7-f9fcfd231892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1515 microversion: 2.1 time: 0.167539 Aug 30 16:01:05.235203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 129/262] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:05 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1515 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:05.546702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:05.547372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:05.554571 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:05.555052 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:05.555685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:05.556386 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:05.556838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:05.557277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:05.698214 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:05.706979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6c8e85f-d8f8-4e56-bfc2-b0c4210ef025 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.164095 Aug 30 16:01:05.707644 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 134/263] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:05 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:06.095093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-53c77cfa-bb86-4eca-b1b9-a0ab71099ede req-c25a28f6-2b01-4398-8020-becf6be7d37a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "41914138-d3f8-408c-87af-b6a64a351bf6", "tag": "c808578e-bb05-4101-8687-0cd4c035f83e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:06.126746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-53c77cfa-bb86-4eca-b1b9-a0ab71099ede req-c25a28f6-2b01-4398-8020-becf6be7d37a service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.127465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-53c77cfa-bb86-4eca-b1b9-a0ab71099ede req-c25a28f6-2b01-4398-8020-becf6be7d37a service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.128217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-53c77cfa-bb86-4eca-b1b9-a0ab71099ede req-c25a28f6-2b01-4398-8020-becf6be7d37a service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.144055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-53c77cfa-bb86-4eca-b1b9-a0ab71099ede req-c25a28f6-2b01-4398-8020-becf6be7d37a service nova] Creating event network-changed:c808578e-bb05-4101-8687-0cd4c035f83e for instance 41914138-d3f8-408c-87af-b6a64a351bf6 on hv-cinder-85505 Aug 30 16:01:06.151270 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-53c77cfa-bb86-4eca-b1b9-a0ab71099ede req-c25a28f6-2b01-4398-8020-becf6be7d37a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061430 Aug 30 16:01:06.165695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 130/264] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:06.633874 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:06.636657 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:06.644513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.645146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.645860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.646831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.647441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.647964 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.672151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lazy-loading 'flavor' on Instance uuid 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:01:06.729072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:06.729801 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:06.736389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.736938 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.737776 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.738491 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.738939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.739398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.796007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ebb2261f-624c-41df-b27b-0193b42ef239 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/action" status: 200 len: 32 microversion: 2.1 time: 0.166559 Aug 30 16:01:06.796865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 135/265] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:01:06 2022] POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:01:06.815641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:06.816664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:06.823349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.823935 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.824417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.825174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:06.825718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:06.826209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:06.920123 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:06.930495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d2f99b25-aafc-4f9c-b7e5-b5016f873aaa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.205976 Aug 30 16:01:06.936474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 131/266] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:06 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:06.978506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:06.986590 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2280f9a8-581b-4eeb-bca6-9aad333487cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.175952 Aug 30 16:01:06.987175 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 136/267] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:06 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:07.952043 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:07.952833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:07.960137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:07.961111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:07.962370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:07.963285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:07.963939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:07.964559 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:08.016900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:08.018291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:08.030785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:08.031648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:08.032262 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:08.033668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:08.034277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:08.035867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:08.284673 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:08.296605 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0657bdfa-5906-48fb-92f0-8ac46ae12958 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.349218 Aug 30 16:01:08.298054 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 132/268] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:07 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:08.370112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:08.386341 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:08.387225 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:08.391947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3744b9a2-4bca-44dd-b0d0-9ec7cd944da9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.381124 Aug 30 16:01:08.396464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:08.397785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 137/269] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:08 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:08.398448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:08.399022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:08.399882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:08.400463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:08.401072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:08.427560 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-692c18eb-4636-4c1e-9860-16f00406d20a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/ips" status: 200 len: 153 microversion: 2.20 time: 0.045429 Aug 30 16:01:08.434290 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 133/270] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Aug 30 16:01:08 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/ips => generated 153 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:01:09.317551 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:09.318259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:09.326235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:09.326709 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:09.327140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:09.327838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:09.328342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:09.328762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:09.421130 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:09.422607 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:09.429791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:09.430397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:09.430918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:09.434688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:09.435563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:09.436119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:09.554945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:09.564565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f11e54ee-bcc8-4e6c-8a33-8f5a9da84fc0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.250397 Aug 30 16:01:09.565325 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 138/271] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:09 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:09.642007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:09.653191 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5511ad3f-2ee7-4fa5-a9a0-653078324b31 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.235938 Aug 30 16:01:09.657268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 134/272] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:09 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:10.586981 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:10.587565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:10.593864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:10.594352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:10.594776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:10.595455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:10.595917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:10.596316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:10.674146 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:10.674753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:10.681935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:10.682696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:10.683287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:10.684187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:10.684793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:10.685570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:10.784324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:10.801787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-71d053cf-778b-491e-b5bd-ea377ff621f5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.216710 Aug 30 16:01:10.817417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 139/273] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:10 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:10.856249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:10.860006 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:10.866354 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2861fc56-dd3a-4146-9535-54c2db827a0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.196172 Aug 30 16:01:10.866944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 135/274] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:10 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:11.277778 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:11.278288 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:11.280484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:11.286372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.286868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.287278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.287962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.288402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.288813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.311688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lazy-loading 'flavor' on Instance uuid 54113782-135e-4dda-a0e9-600a7fa1ec9b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:01:11.386407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:11.517588 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4631acd3-4089-478e-890b-9594835cbb69 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/action" status: 202 len: 0 microversion: 2.20 time: 0.244011 Aug 30 16:01:11.518298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 140/275] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 30 16:01:11 2022] POST /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/action => generated 0 bytes in 246 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:01:11.527742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:11.528578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:11.531819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:11.532508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:11.545395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.545395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.545395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.545395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.545742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.545742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.676814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:11.685877 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:11.687302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:11.688530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-57b2c0e4-09c2-4364-8903-f612aa774c93 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.165279 Aug 30 16:01:11.689054 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 136/276] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:11 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:11.827958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:11.828739 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:11.835960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.836435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.836860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.837585 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.838079 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.838745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.887245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:11.887835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:11.893832 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.894302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.894714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.895382 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:11.895817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:11.896225 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:11.978984 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:11.988792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6523de52-a730-443e-a562-13d776deb6e5 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.167770 Aug 30 16:01:11.989511 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 141/277] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:11 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:12.180122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:12.188198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-be9ba18a-85a8-47d1-a6cc-8a5b4d5030a8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.304794 Aug 30 16:01:12.188810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 137/278] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:11 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:12.684813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0dae363a-9602-493e-b8fc-b8894a04acda tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: .version_select at 0x7f4848461940>, body: {"keypair": {"name": "tempest-keypair-1171908399", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIudd7v9BrDc6NPuV9Bt+JQZhRzxAjZsgmG+lsVzpSpq6maHk6234PbE+1wygB5RXMu9TtwZTVctaINO56qe7NmgLf+Okr4nhNcaeyuHGDEG+Dc2EbKHtEazl0uF+Pnj4A=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:12.704302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-0dae363a-9602-493e-b8fc-b8894a04acda tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:12.713066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:12.713609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:12.720221 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:12.720805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:12.721152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:12.721892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:12.722332 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:12.724565 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-0dae363a-9602-493e-b8fc-b8894a04acda tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:12.727771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:12.787516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0dae363a-9602-493e-b8fc-b8894a04acda tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106482 Aug 30 16:01:12.790220 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 142/279] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:01:12 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:12.930921 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:12.942654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:12.947218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:12.949387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-976aae4f-1fa6-4e61-a866-409d08f52793 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.240355 Aug 30 16:01:12.950673 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 138/280] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:12 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:13.016029 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:13.018668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:13.029368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.030155 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.030600 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:13.031368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.031885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.032536 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:13.056859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d1aa39be-491d-4cb5-a425-65b2a9c1822d req-4200faec-6cb7-468b-a61b-1172d6129c64 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41914138-d3f8-408c-87af-b6a64a351bf6", "name": "network-vif-plugged", "status": "completed", "tag": "c808578e-bb05-4101-8687-0cd4c035f83e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:13.068249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d1aa39be-491d-4cb5-a425-65b2a9c1822d req-4200faec-6cb7-468b-a61b-1172d6129c64 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.068952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d1aa39be-491d-4cb5-a425-65b2a9c1822d req-4200faec-6cb7-468b-a61b-1172d6129c64 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.069600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d1aa39be-491d-4cb5-a425-65b2a9c1822d req-4200faec-6cb7-468b-a61b-1172d6129c64 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:13.083586 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d1aa39be-491d-4cb5-a425-65b2a9c1822d req-4200faec-6cb7-468b-a61b-1172d6129c64 service nova] Creating event network-vif-plugged:c808578e-bb05-4101-8687-0cd4c035f83e for instance 41914138-d3f8-408c-87af-b6a64a351bf6 on hv-cinder-85505 Aug 30 16:01:13.092454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d1aa39be-491d-4cb5-a425-65b2a9c1822d req-4200faec-6cb7-468b-a61b-1172d6129c64 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039129 Aug 30 16:01:13.093931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 139/281] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:13.210121 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:13.210849 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:13.218720 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.219192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.219520 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:13.220692 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.221267 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.221776 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:13.573002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:13.582059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6a00577e-c56b-478f-8410-4b31576578e7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.574430 Aug 30 16:01:13.582699 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 143/282] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:13 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:13.650401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:13.660536 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3d17cc73-2309-4d8a-bd6c-14646ec17a91 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.455588 Aug 30 16:01:13.661652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 140/283] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:13 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:13.975460 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:13.976057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:13.978107 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=74,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:13.984868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.985744 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.986172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:13.987023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:13.987729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:13.988203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:14.154765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:14.163668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:14.165778 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:14.167138 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0c38c07c-a872-4eeb-94ea-0c398b47a459 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.195981 Aug 30 16:01:14.167988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 144/284] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:13 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:14.607104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:14.608393 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:14.611007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:14.617473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:14.618163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:14.618766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:14.619541 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:14.620171 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:14.620639 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:14.682144 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:14.682758 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:14.690345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:14.690845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:14.691846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:14.691988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:14.692427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:14.692847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:14.866657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:14.874581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ff2b8e67-1c4f-47b1-b2df-3bde1b21f8df tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.274684 Aug 30 16:01:14.875824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 141/285] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:14 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:14.881313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-279551885", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3aa7438-61b4-41af-81a0-39b48f126de4"}], "security_groups": [{"name": "tempest-securitygroup--1366267204"}], "key_name": "tempest-keypair-1171908399", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:14.929914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:14.942114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f2460a5-0604-4410-ad2f-c208b1029517 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.263679 Aug 30 16:01:14.942547 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 145/286] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:14 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:15.009459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] validate_networks() for [('b3aa7438-61b4-41af-81a0-39b48f126de4', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:01:15.191291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:15.192018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:15.198668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.199202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.199641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.200373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.200820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.201600 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.436552 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:15.446461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:15.448498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:15.450387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-126c5c13-3437-4d31-92bf-1b168eabfea5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.263914 Aug 30 16:01:15.451004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 146/287] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:15 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:15.486966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:01:15.487728 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:01:15.488192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:01:15.488793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:01:15.489197 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:01:15.498011 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.498487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.498912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.499630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.500076 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.500496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.517745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:15.524913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:15.533975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:01:15.536323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:01:15.585631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c89161b7-a86e-4be4-81c0-c3c27cd96d9e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.708212 Aug 30 16:01:15.586814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 142/288] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:01:14 2022] POST /compute/v2.1/servers => generated 402 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:01:15.597552 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9fcf4f7-838a-4266-96cb-f19ba8dc3ffe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:15.598162 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9fcf4f7-838a-4266-96cb-f19ba8dc3ffe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:15.652593 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9fcf4f7-838a-4266-96cb-f19ba8dc3ffe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:15.661455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9fcf4f7-838a-4266-96cb-f19ba8dc3ffe tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1241 microversion: 2.1 time: 0.066412 Aug 30 16:01:15.661455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 147/289] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:15 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:15.899343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:15.900157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:15.921854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.922634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.923222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.924152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.924881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.925415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.971637 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:15.972324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:15.982326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.982851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.983280 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:15.983991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:15.984437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:15.984853 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:16.136695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:16.147437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bab8486d-cea0-433c-9e4f-cf334114e7b7 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.252753 Aug 30 16:01:16.148888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 143/290] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:15 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:16.184789 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:16.203897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-29ada097-2e53-435e-bd7d-5fa3e5db0444 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.240118 Aug 30 16:01:16.203897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 148/291] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:15 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:16.478469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:16.479398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:16.488302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:16.488773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:16.489195 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:16.489900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:16.490342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:16.490754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:16.641933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:16.650754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:16.652209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:16.653395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-392dbdd0-0b8c-47ea-a3dd-203adc433b5e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.181687 Aug 30 16:01:16.653951 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 144/292] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:16 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:16.683331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:16.684185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:16.692538 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:16.693024 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:16.693500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:16.694193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:16.694643 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:16.695070 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:16.759608 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:16.767230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b91cc6e9-7876-44b8-9fc5-4b7a57a729f4 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1245 microversion: 2.1 time: 0.090286 Aug 30 16:01:16.767800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 149/293] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:16 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:17.172167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:17.173137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:17.180784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.181266 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.181728 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.182429 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.182848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.183260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.222458 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:17.223049 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:17.229880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.230363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.230788 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.231507 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.231951 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.232363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.360178 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:17.368609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ee68d6c3-7043-4801-9792-277c239c97ae tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1313 microversion: 2.1 time: 0.203058 Aug 30 16:01:17.369468 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 145/294] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:17 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1313 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:17.390926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:17.399843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3fbf044a-15a2-47b6-b114-e376b14101a7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.181199 Aug 30 16:01:17.400411 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 150/295] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:17 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:17.680326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:17.681125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:17.691014 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.691487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.691874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.692581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.693017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.693473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.787891 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:17.788473 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:17.794731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.795222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.795653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.796356 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:17.796864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:17.797279 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:17.831031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:17.839534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:17.840972 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:17.842184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d8003323-87eb-40f1-9d4b-862952fd57f9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.168765 Aug 30 16:01:17.842724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 146/296] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:17 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:17.859664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:17.868084 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d84a0dcb-95c0-4c7b-acb8-c667da13b4f7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1245 microversion: 2.1 time: 0.084199 Aug 30 16:01:17.868641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 151/297] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:17 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:18.388875 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:18.389501 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:18.396381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.396869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.397321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.398017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.398465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.398880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.419811 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:18.420479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:18.427080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.427564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.427990 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.428686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.429133 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.429582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.599359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:18.607372 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d2fe5645-2a01-44e4-9243-e636ef6c3a31 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1497 microversion: 2.1 time: 0.222274 Aug 30 16:01:18.607950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 147/298] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:18 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1497 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:18.629057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:18.644092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-059c0eac-8905-4e15-91b8-170647dbbda1 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.227580 Aug 30 16:01:18.646482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 152/299] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:18 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:18.864788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:18.865319 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:18.871353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.871824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.872240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.872911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.873375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.873785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.888496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:18.889380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:18.896882 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.897414 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.897829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.898707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:18.899157 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:18.899576 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:18.989517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:18.997280 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80695dbd-f279-404e-93bc-aa8184910ae2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1293 microversion: 2.1 time: 0.112728 Aug 30 16:01:18.997861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 153/300] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:18 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1293 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:19.055045 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:19.063924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:19.065386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:19.066562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d7e56a06-35d3-4fee-91c9-0ab4d9310161 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.206286 Aug 30 16:01:19.067137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 148/301] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:18 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:19.667482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:19.668059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:19.675461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:19.675900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:19.676331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:19.677019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:19.677491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:19.677908 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:19.810796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:19.818708 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d1023746-6b65-45f6-bfcb-961779295ad3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.155155 Aug 30 16:01:19.819291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 154/302] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:19 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:20.021820 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:20.022360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:20.029189 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:20.029718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:20.030148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:20.030843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:20.031299 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:20.031721 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:20.090816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:20.091419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:20.094853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:20.097594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:20.098077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:20.098510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:20.099199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:20.099691 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:20.100109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:20.102926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-148c6eb8-bad3-4cdd-babc-0ab3d507cffd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1301 microversion: 2.1 time: 0.087449 Aug 30 16:01:20.103548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 149/303] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:20 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1301 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:20.231251 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:20.240365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:20.241860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:20.243005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a112b11-acab-4074-b462-df34108c123a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.156652 Aug 30 16:01:20.243560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 155/304] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:20 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:20.844142 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:20.844999 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:20.855242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:20.856025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:20.856671 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:20.857892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:20.858625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:20.859311 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:20.993903 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:21.006420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-09f2d659-8ecd-4802-8d32-4ed19c3f8d19 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.168875 Aug 30 16:01:21.007179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 150/305] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:20 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:21.126766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:21.127460 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:21.135001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.135477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.135907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.136586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.137037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.137490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.209617 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:21.222501 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66ea3ce5-ad46-4310-a327-0c9ffbe790d3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1301 microversion: 2.1 time: 0.101208 Aug 30 16:01:21.223417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 156/306] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:21 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1301 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:21.266971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:21.267598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:21.274735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.275238 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.275662 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.276341 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.276784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.277196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.416922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:21.430342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:21.432703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:21.434628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d02e9de-745f-4e0f-a65b-a15acc2348bc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.171459 Aug 30 16:01:21.435501 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 151/307] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:21 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:21.792362 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:21.793143 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:21.799791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.800544 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.800976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.801787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.802369 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.802905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.837407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:01:21.892905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:21.934395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a7935c1-0677-4038-89fb-e4c2ee691170 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "DELETE /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 204 len: 0 microversion: 2.1 time: 0.145263 Aug 30 16:01:21.935359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 157/308] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:01:21 2022] DELETE /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:01:21.944398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:21.945122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:21.953430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.953917 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.954343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:21.955038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:21.955479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:21.955894 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.034487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:22.035319 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:22.042443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:22.043070 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:22.043513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.044250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:22.044714 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:22.046038 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.214805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:22.222767 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-211b4843-c5c2-41f7-a071-ef4bf4807985 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1503 microversion: 2.1 time: 0.282940 Aug 30 16:01:22.223338 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 152/309] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:21 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1503 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:22.243931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:22.244530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:22.251286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:22.251744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:22.252232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.252905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:22.253538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:22.253981 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.266848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:22.275728 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bae516f-1963-4916-81b1-206f35c5902a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.247004 Aug 30 16:01:22.289085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 158/310] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:22 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:22.335183 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:22.338793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:22.343534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-274f999c-7808-4645-aea7-9fecc9e45e9c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1299 microversion: 2.1 time: 0.103279 Aug 30 16:01:22.344160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 153/311] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:22 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1299 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:22.460639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:22.461259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:22.467306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:22.467782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:22.468415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.469106 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:22.469603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:22.470004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:22.631546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:22.640055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:22.641513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:22.642649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17eba0de-a807-4614-b360-af1162ee6ce3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.186344 Aug 30 16:01:22.643463 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 159/312] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:22 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:23.245442 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:23.245956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:23.252815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.253334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.253764 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.254452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.254898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.255317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.296636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:23.297390 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:23.303996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.304566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.305068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.305875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.306396 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.306953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.485448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:23.494143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-105dd844-b194-4e29-91d1-3f9831f9c540 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1503 microversion: 2.1 time: 0.252820 Aug 30 16:01:23.494719 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 154/313] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:23 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1503 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:23.512579 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:23.513200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:23.519318 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.519797 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.520220 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.520915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.521403 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.521802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.552902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:23.561863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5b6a6cce-9ed8-4d0a-95cb-75f836cf698b tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.268974 Aug 30 16:01:23.562905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 160/314] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:23 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:23.665632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:23.666346 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:23.672616 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.673183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.673731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.674677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:23.675301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:23.675729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:23.819815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:23.828219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-95699bd1-e14e-442f-9ea4-623ab32acfde tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.322018 Aug 30 16:01:23.839828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 155/315] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:23 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:23.918821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:23.929822 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:23.931339 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:23.932658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dc59041e-11a9-41be-baf0-a7b6808f6edc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.270998 Aug 30 16:01:23.945972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 161/316] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:23 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:24.156102 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-304f1d4a-f203-46a9-918f-562faccb2aff req-95b15283-675e-4e2f-b0c6-9139bb42783c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "41914138-d3f8-408c-87af-b6a64a351bf6", "name": "network-vif-deleted", "tag": "c808578e-bb05-4101-8687-0cd4c035f83e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:24.171040 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-304f1d4a-f203-46a9-918f-562faccb2aff req-95b15283-675e-4e2f-b0c6-9139bb42783c service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.171608 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-304f1d4a-f203-46a9-918f-562faccb2aff req-95b15283-675e-4e2f-b0c6-9139bb42783c service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.172250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-304f1d4a-f203-46a9-918f-562faccb2aff req-95b15283-675e-4e2f-b0c6-9139bb42783c service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.188168 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-304f1d4a-f203-46a9-918f-562faccb2aff req-95b15283-675e-4e2f-b0c6-9139bb42783c service nova] Creating event network-vif-deleted:c808578e-bb05-4101-8687-0cd4c035f83e for instance 41914138-d3f8-408c-87af-b6a64a351bf6 on hv-cinder-85505 Aug 30 16:01:24.197404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-304f1d4a-f203-46a9-918f-562faccb2aff req-95b15283-675e-4e2f-b0c6-9139bb42783c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045312 Aug 30 16:01:24.198724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 156/317] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:24.296072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-778a48f6-aa1d-4df6-aa22-5dc6f526fa2a req-240ee72a-45a9-43af-a523-eebdd7c4ef04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "096b49e4-be8b-48c6-88a3-19b6a555ff37", "tag": "6b029260-3e6c-4a95-bbdd-4563d871c661"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:24.309767 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-778a48f6-aa1d-4df6-aa22-5dc6f526fa2a req-240ee72a-45a9-43af-a523-eebdd7c4ef04 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.310432 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-778a48f6-aa1d-4df6-aa22-5dc6f526fa2a req-240ee72a-45a9-43af-a523-eebdd7c4ef04 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.310653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-778a48f6-aa1d-4df6-aa22-5dc6f526fa2a req-240ee72a-45a9-43af-a523-eebdd7c4ef04 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.329032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-778a48f6-aa1d-4df6-aa22-5dc6f526fa2a req-240ee72a-45a9-43af-a523-eebdd7c4ef04 service nova] Creating event network-changed:6b029260-3e6c-4a95-bbdd-4563d871c661 for instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 on hv-cinder-85505 Aug 30 16:01:24.334374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-778a48f6-aa1d-4df6-aa22-5dc6f526fa2a req-240ee72a-45a9-43af-a523-eebdd7c4ef04 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041796 Aug 30 16:01:24.335275 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 162/318] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:24.520036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:24.520864 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:24.527775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.528388 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.529007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.530169 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.530793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.531262 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.583244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:24.583966 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:24.590529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.591039 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.591470 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.592170 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.592613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.593032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.868934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:24.877652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-db88eca8-acf2-4cf5-ad8b-87ed0dbe26fa tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1461 microversion: 2.1 time: 0.361819 Aug 30 16:01:24.878219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 157/319] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:24 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1461 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:24.895884 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:24.897401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:24.906476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.907790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.908398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:24.909312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:24.910075 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:24.910788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:25.123776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:25.133037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4243edc-871d-4001-a543-74988dfc1543 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.553953 Aug 30 16:01:25.133955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 163/320] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:24 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:25.139509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:25.140083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:25.160270 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:25.160946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:25.161537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:25.167302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:25.169327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:25.170533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:25.336648 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:25.349290 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-004760dd-89dc-46bd-9c6e-8b513c839924 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.469799 Aug 30 16:01:25.350688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 158/321] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:24 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:25.540092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:25.548249 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:25.549714 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:25.550877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbae392d-770d-44e7-acd6-f0f240290ae0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.415926 Aug 30 16:01:25.551448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 164/322] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:25 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:25.904007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:25.905199 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:25.907501 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:25.908649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:25.918295 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:25.918721 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:25.919155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:25.920258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:25.920371 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:25.920910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:25.960092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:25.960970 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:25.961610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:25.962051 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lazy-loading 'fault' on Instance uuid 41914138-d3f8-408c-87af-b6a64a351bf6 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:01:26.014363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:26.027810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-58ee5561-9e50-4cce-b7f1-e741dcca690d tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 200 len: 1303 microversion: 2.1 time: 0.129776 Aug 30 16:01:26.038329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 159/323] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:25 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 1303 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:26.160289 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:26.160863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:26.163404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:26.168694 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:26.169284 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:26.170112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:26.171292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:26.171951 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:26.172582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:26.373928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:26.374629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:26.378150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:26.390226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eec20914-e964-48af-a2b9-59605aedb4d9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.233319 Aug 30 16:01:26.393352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:26.394084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:26.394712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 165/324] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:26 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:26.395149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:26.396017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:26.396787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:26.397493 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:26.576152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:26.577436 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:26.588674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:26.590078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:26.590603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:26.591516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:26.592219 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:26.592745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:26.618772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:26.650655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51d9d8a9-da25-40de-b3f3-c353cf9416c6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.282504 Aug 30 16:01:26.651218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 160/325] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:26 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:26.808579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:26.817156 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:26.818887 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:26.820200 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c102eb8e-1247-43f3-af05-97aaaf517325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.249245 Aug 30 16:01:26.821313 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 166/326] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:26 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:27.050326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:27.050934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 41914138-d3f8-408c-87af-b6a64a351bf6] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:27.063211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:27.063788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:27.064115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:27.064928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:27.065374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:27.065684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:27.082867 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] HTTP exception thrown: Instance 41914138-d3f8-408c-87af-b6a64a351bf6 could not be found. Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Request method failure captured: Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 HTTP/1.1 Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjQ62J1LknOESrx2Xz5Ckc13FqnX_AEo9w5XVRrVZMVIb-5qMpEqEkwZ1f10YrSjZhGEYfx1N8ZSP7KZrcfCAhv6SB_f7LhNYxV8NdSP08n3OhEZIY8-YhqFMvbgz836xcbyLlImHH2FKgmRmxZbJ_U8PpRo3fWJ_EyjsFp8rr7DalY Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 80493f357d57418cb58f8a33e82b8822 Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesActionsTest-1539826875 Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:01:27.086412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80493f357d57418cb58f8a33e82b8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80493f357d57418cb58f8a33e82b8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80493f357d57418cb58f8a33e82b8822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80493f357d57418cb58f8a33e82b8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesActionsTest-1539826875 Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 80493f357d57418cb58f8a33e82b8822 Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesActionsTest-1539826875 Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesActionsTest-1539826875-project Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: e9fdf5c5f263474bb41ab41bdac6f78f Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesActionsTest-1539826875-project Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 41914138-d3f8-408c-87af-b6a64a351bf6 could not be found. Aug 30 16:01:27.087744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '41914138-d3f8-408c-87af-b6a64a351bf6'} Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 41914138-d3f8-408c-87af-b6a64a351bf6 could not be found. Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:01:27.088597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 41914138-d3f8-408c-87af-b6a64a351bf6 could not be found. Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 41914138-d3f8-408c-87af-b6a64a351bf6 could not be found. Aug 30 16:01:27.089962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:01:27.092567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Returning 404 to user: Instance 41914138-d3f8-408c-87af-b6a64a351bf6 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:01:27.093710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ef393ad3-a86e-4b26-9a63-af1da0d534ff tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6" status: 404 len: 111 microversion: 2.1 time: 0.047282 Aug 30 16:01:27.094739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 161/327] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:27 2022] GET /compute/v2.1/servers/41914138-d3f8-408c-87af-b6a64a351bf6 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:01:27.236090 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1974737529", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "networks": [{"uuid": "d84bf345-feb7-4272-923c-4d088bd34594"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:27.294783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] validate_networks() for [('d84bf345-feb7-4272-923c-4d088bd34594', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:01:27.415602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:27.416223 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:27.422260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:27.422751 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:27.423183 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:27.423886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:27.424336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:27.424768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:27.832478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:27.845602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-baea6510-48dc-4486-aa53-dbb2dae5969e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1501 microversion: 2.1 time: 0.433761 Aug 30 16:01:27.862567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 162/328] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:27 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1501 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:27.876483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:27.877448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:27.884651 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:27.886009 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:27.886352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:27.887032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:27.887477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:27.887932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.134227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:01:28.137742 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:01:28.138398 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:01:28.140497 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:01:28.140757 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:01:28.174625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.175183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.175844 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.178528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.180168 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.180800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.205672 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Getting quotas for project 80493f357d57418cb58f8a33e82b8822. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:28.211389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Getting quotas for user e9fdf5c5f263474bb41ab41bdac6f78f and project 80493f357d57418cb58f8a33e82b8822. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:28.223090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:28.232899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2915cf69-6f7d-48e2-a001-74ab03de0ca0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.368410 Aug 30 16:01:28.234004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 163/329] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:27 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:28.241474 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:01:28.244190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:28.245516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:28.246873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:01:28.255182 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.256483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.257637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.258704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.259222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.259795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.324770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d05f676c-8bfa-4900-9ede-5a82ff61b68c tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.092442 Aug 30 16:01:28.331145 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 167/330] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:01:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 1094 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:01:28.337423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f7018937-bd91-4533-83aa-cad616787389"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:28.340088 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:28.365729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.366224 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.366873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.367748 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.368203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.368628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.397616 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] HTTP exception thrown: Cannot 'attach_volume' instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac while it is in vm_state rescued Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Request method failure captured: Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/os-volume_attachments HTTP/1.1 Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 74 Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPbErh-lB5Rzlrt__YAi7syzEIzJE3yxDpiA5zbNCOrdVke1rtd2l_gAtR9dNM50llV3cAqlovCsNO5_om48W_hTZXnsSe27UOQdEFxyENhLjzUjAxkuy0_M3r2mOeT3E7C3kvowrhlBvNMeP2gsFJCVoMgg47z2rk4Y9zVIzJl77g Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:01:28.399676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: c34836a75f144f74aa3fd6a38ccb9791 Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {"volumeAttachment": {"volumeId": "f7018937-bd91-4533-83aa-cad616787389"}} Aug 30 16:01:28.401132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Cannot 'attach_volume' instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac while it is in vm_state rescued Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'server_id': '9ab35a6d-8b8e-470e-8e4c-16ca84a742ac', 'body': {'volumeAttachment': {'volumeId': 'f7018937-bd91-4533-83aa-cad616787389'}}} Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac in vm_state rescued. Cannot attach_volume while the instance is in this state. Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:01:28.408461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac while it is in vm_state rescued Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:01:28.413896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:01:28.415433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:01:28.415433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:01:28.415433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac while it is in vm_state rescued Aug 30 16:01:28.415433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:28.416764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Returning 409 to user: Cannot 'attach_volume' instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac while it is in vm_state rescued {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:01:28.423046 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd5bc2c3-0076-40ab-a493-b5fb7f6898d7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.090422 Aug 30 16:01:28.424208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 168/331] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:01:28 2022] POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/os-volume_attachments => generated 152 bytes in 92 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:01:28.430564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0eb312c7-f0ba-442f-a57d-12eb21fda71f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:28.431482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0eb312c7-f0ba-442f-a57d-12eb21fda71f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:28.559097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0eb312c7-f0ba-442f-a57d-12eb21fda71f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:28.567276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0eb312c7-f0ba-442f-a57d-12eb21fda71f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1214 microversion: 2.1 time: 0.141600 Aug 30 16:01:28.577996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 169/332] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:28 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:28.589234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:28.590260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:28.598800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.602680 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.603213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.603965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.604426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.604852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.683255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:28.705583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:28.707661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:28.709697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2e2d3b6c-e7de-4dae-980c-78e522b72c7e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.473953 Aug 30 16:01:28.710779 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 164/333] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:28 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:28.720480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-19665310-7b94-43de-9839-db7076cf8e81 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/action" status: 202 len: 0 microversion: 2.1 time: 0.136087 Aug 30 16:01:28.721047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 170/334] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:01:28 2022] POST /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac/action => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:01:28.736619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:28.738245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:28.748778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.749283 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.749714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.750457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:28.751109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:28.751526 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:28.981491 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:29.000298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-23645b38-715d-4fcb-a355-665486d87b5e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1509 microversion: 2.1 time: 0.266154 Aug 30 16:01:29.001030 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 165/335] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:28 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1509 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:29.257923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:29.259073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:29.270643 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:29.271407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:29.276153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:29.279892 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:29.280617 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:29.282520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:29.596957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:29.600270 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:29.621329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:29.622236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:29.658031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:29.659756 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:29.662887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:29.667059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:29.959723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:29.969008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-617315a0-1d6f-4a9b-bfc4-78541a9ebb4a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1266 microversion: 2.1 time: 0.381210 Aug 30 16:01:29.969896 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 166/336] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:29 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1266 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:29.983784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:29.984391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:29.991785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:29.992228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:29.992704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:29.994032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:29.994685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:29.995420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:30.016949 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:30.040687 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0dfb511a-b938-4522-b34b-ffc77fed0909 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.786708 Aug 30 16:01:30.049250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 171/337] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:29 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:30.049250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:30.049250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:30.054032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:30.054890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:30.055572 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:30.064934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:30.069846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:30.070985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:30.361749 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:30.364512 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:30.377864 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:30.380498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:30.381780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72c38b47-d7bc-4500-bc74-12eebaf3448a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1509 microversion: 2.1 time: 0.339094 Aug 30 16:01:30.382556 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 172/338] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:30 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1509 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:30.382752 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5da5bf22-4016-4ea2-9009-d031ac0add1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.403398 Aug 30 16:01:30.392238 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 167/339] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:29 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:30.992363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:30.993309 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:30.999593 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.000320 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.000902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.001819 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.002418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.002993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.066507 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:31.068017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:31.078025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.078895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.079592 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.080563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.081311 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.081923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.107776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:31.125096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f5762b4b-e44e-4de3-a3bf-80bfa5719f8f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1266 microversion: 2.1 time: 0.136371 Aug 30 16:01:31.125876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 173/340] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:30 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1266 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:31.263811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:31.272803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-46df3da1-2018-44fa-9c7a-a94911703ca1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.211643 Aug 30 16:01:31.280230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 168/341] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:31 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:31.406240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:31.413446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:31.414436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:31.416246 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:31.426720 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.430098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.432716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.433888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.435103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.435482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.436061 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.437989 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:31.438273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.438942 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.454353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:31.460237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:31.853425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:31.865938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b3d0c050-056f-458b-8917-7b27de9fb67f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1509 microversion: 2.1 time: 0.465821 Aug 30 16:01:31.874282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:31.883303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:31.883737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 174/342] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:31 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1509 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:31.886923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:31.888819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a2ae0351-675a-4c43-a246-6e34cd8ee72a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.486401 Aug 30 16:01:31.889967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 169/343] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:31 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:32.145462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:32.146068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:32.155984 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.160482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.161105 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.161906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.162374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.166627 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.262378 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:32.271922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3eadd3e-0402-4a1d-ad6b-adc1d0cda1f8 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1274 microversion: 2.1 time: 0.129925 Aug 30 16:01:32.273553 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 175/344] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:32 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1274 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:32.300184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:32.300781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:32.307395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.308073 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.308689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.309752 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.310339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.311048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.519548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:32.527571 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1b158971-b003-41b3-a9e4-1a1d6f2ba5b1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.231100 Aug 30 16:01:32.528080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 170/345] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:32 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:32.904392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:32.905360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:32.912616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:32.913511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:32.926849 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.928111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.928674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.929120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.930131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.930647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.931821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.933069 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.934010 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.936214 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:32.936966 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:32.938445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:32.952528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:32.993580 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:33.252195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:33.265158 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5924f03-5238-4d15-b304-3f94aa1365c9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1515 microversion: 2.1 time: 0.364976 Aug 30 16:01:33.300113 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:33.312367 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 176/346] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:32 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1515 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:33.316004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:33.317650 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:33.321389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:33.322692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:33.325707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4257bdc0-f027-42e7-b882-621d2e93a27c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1744 microversion: 2.20 time: 0.411106 Aug 30 16:01:33.327663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 171/347] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:32 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1744 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:33.331223 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:33.332502 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:33.333241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:33.334455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:33.335050 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:33.335669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:33.409635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-2a76cac0-5c5e-4f01-a406-6cca93b3782a req-c25a7796-060e-4045-b091-d1539a5bdd33 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096b49e4-be8b-48c6-88a3-19b6a555ff37", "name": "network-vif-plugged", "status": "completed", "tag": "6b029260-3e6c-4a95-bbdd-4563d871c661"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:33.433315 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2a76cac0-5c5e-4f01-a406-6cca93b3782a req-c25a7796-060e-4045-b091-d1539a5bdd33 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:33.433773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2a76cac0-5c5e-4f01-a406-6cca93b3782a req-c25a7796-060e-4045-b091-d1539a5bdd33 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:33.434188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2a76cac0-5c5e-4f01-a406-6cca93b3782a req-c25a7796-060e-4045-b091-d1539a5bdd33 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:33.461866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-2a76cac0-5c5e-4f01-a406-6cca93b3782a req-c25a7796-060e-4045-b091-d1539a5bdd33 service nova] Creating event network-vif-plugged:6b029260-3e6c-4a95-bbdd-4563d871c661 for instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 on hv-cinder-85505 Aug 30 16:01:33.480474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-2a76cac0-5c5e-4f01-a406-6cca93b3782a req-c25a7796-060e-4045-b091-d1539a5bdd33 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074330 Aug 30 16:01:33.481089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 172/348] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:01:33.548596 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:33.549308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:33.562211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:33.563144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:33.564374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:33.565257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:33.565985 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:33.566547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:33.627994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:33.637599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-33a36268-b611-45a2-8935-f73b7a1801a0 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1272 microversion: 2.1 time: 0.323369 Aug 30 16:01:33.639035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 177/349] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:33 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:34.080568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:34.108850 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85741793-2e75-497a-addf-8645f74d5327 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.556684 Aug 30 16:01:34.109966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 173/350] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:33 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:34.356834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:34.357504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:34.377931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:34.383568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:34.384301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:34.385205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:34.385843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:34.386412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:34.563137 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:34.572479 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:34.579055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:34.581769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a29d65b5-def3-46de-ae49-41dca24aa028 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1744 microversion: 2.20 time: 0.229526 Aug 30 16:01:34.582457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 178/351] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:34 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1744 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:34.661552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:34.662229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:34.671288 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:34.672245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:34.672908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:34.675299 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:34.675919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:34.676867 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:34.897835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:34.908676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cfb4290b-3080-4b78-b98e-4d97c539438e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.253320 Aug 30 16:01:34.909932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 174/352] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:34 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:35.056666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-16b17dd9-5730-43a7-a67b-df678a3c0491 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'create', calling method: .version_select at 0x7f4848189940>, body: {"keypair": {"name": "tempest-keypair-1283955912", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLh8szkAACCRPGZT+JBnMKonsG8OQYrF3MPu3ivsbEJq7qbSN3Svbgrjef5KvVS7J2PspzknQ0bwaLhbpTMtt/2o4wHVfbolpwobpuXvtmoWFfnStBpl57jJWcHvKsGGng=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:35.083292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-16b17dd9-5730-43a7-a67b-df678a3c0491 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:35.088721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-16b17dd9-5730-43a7-a67b-df678a3c0491 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for user c34836a75f144f74aa3fd6a38ccb9791 and project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:35.094173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:35.136408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:35.137556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:35.144351 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-16b17dd9-5730-43a7-a67b-df678a3c0491 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.098881 Aug 30 16:01:35.148420 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 179/353] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:01:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:35.148965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.149801 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.150698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:35.151928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.153049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.153977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:35.303004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-b762b6ab-7e86-49ff-8812-1d33b697c1af req-7cc113e8-a126-4342-9961-e685d2a8f20f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57693244-648a-492d-a8a0-461cdeff222a", "tag": "9c19c80b-3f6c-47e9-ab99-a9cf1b0f4057"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:35.323808 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b762b6ab-7e86-49ff-8812-1d33b697c1af req-7cc113e8-a126-4342-9961-e685d2a8f20f service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.324305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b762b6ab-7e86-49ff-8812-1d33b697c1af req-7cc113e8-a126-4342-9961-e685d2a8f20f service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.324740 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-b762b6ab-7e86-49ff-8812-1d33b697c1af req-7cc113e8-a126-4342-9961-e685d2a8f20f service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:35.360685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-b762b6ab-7e86-49ff-8812-1d33b697c1af req-7cc113e8-a126-4342-9961-e685d2a8f20f service nova] Creating event network-changed:9c19c80b-3f6c-47e9-ab99-a9cf1b0f4057 for instance 57693244-648a-492d-a8a0-461cdeff222a on hv-cinder-85505 Aug 30 16:01:35.373196 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-b762b6ab-7e86-49ff-8812-1d33b697c1af req-7cc113e8-a126-4342-9961-e685d2a8f20f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073914 Aug 30 16:01:35.374536 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 180/354] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:01:35.606607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:35.607327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:35.620773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.623785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.624250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:35.625477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.626123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.627347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:35.687188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:35.697804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d0dbef17-3645-45a4-abe0-262ae2613b42 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1367 microversion: 2.1 time: 0.567642 Aug 30 16:01:35.698671 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 175/355] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:35 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:35.934140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:35.935055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:35.950718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.951230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.952796 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:35.954619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:35.956513 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:35.958108 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:36.202302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:36.219536 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:36.224525 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:36.229607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ac653dd8-ae54-4ce2-8e94-d656e0c721b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1744 microversion: 2.20 time: 0.626878 Aug 30 16:01:36.232314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 181/356] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:35 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1744 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:36.400748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:36.411945 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9a083ffa-c2b4-4bc0-a7d3-801a7a6c795f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.484838 Aug 30 16:01:36.412783 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 176/357] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:35 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:36.728405 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:36.730572 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:36.751812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:36.756595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:36.759054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:36.760684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:36.764852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:36.766833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.086226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:37.108512 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15549743-3cf4-4b3f-9f0e-d23d6bacc348 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1557 microversion: 2.1 time: 0.386910 Aug 30 16:01:37.126834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 182/358] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:36 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1557 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:37.138654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:37.139684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:37.151989 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.152970 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.153582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.161670 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.162435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.163067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.264091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:37.264594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:37.268568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f8a898fa-92b3-42e2-baac-dbd769696db3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.140145 Aug 30 16:01:37.270267 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 177/359] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:01:37 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/os-interface => generated 284 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:37.281733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.285316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.285886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.286648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.287163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.287750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.436850 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:37.437835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:37.452572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.453657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.454312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.455194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.458095 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.459302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:37.932800 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:37.945549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-822c63a3-b9f2-47cb-9762-dd93314faa3e tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.510727 Aug 30 16:01:37.946900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 178/360] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:37 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:37.960348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-4caa6ce7-619c-4753-967f-9d76aec2392a req-ff8b037e-a6e4-4345-8db2-3937e30ac48a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "name": "network-vif-plugged", "status": "completed", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:37.989087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4caa6ce7-619c-4753-967f-9d76aec2392a req-ff8b037e-a6e4-4345-8db2-3937e30ac48a service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:37.989842 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4caa6ce7-619c-4753-967f-9d76aec2392a req-ff8b037e-a6e4-4345-8db2-3937e30ac48a service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:37.990511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-4caa6ce7-619c-4753-967f-9d76aec2392a req-ff8b037e-a6e4-4345-8db2-3937e30ac48a service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:38.024466 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-4caa6ce7-619c-4753-967f-9d76aec2392a req-ff8b037e-a6e4-4345-8db2-3937e30ac48a service nova] Creating event network-vif-plugged:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 16:01:38.039376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-4caa6ce7-619c-4753-967f-9d76aec2392a req-ff8b037e-a6e4-4345-8db2-3937e30ac48a service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091030 Aug 30 16:01:38.041043 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 179/361] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:38.089165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:38.114244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:38.116300 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:38.119982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c5a6c7e8-b590-4f0c-b927-f99795bba032 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.858534 Aug 30 16:01:38.135901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 183/362] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:37 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 876 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:38.970438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:38.971156 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:38.989077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:38.989615 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:38.997744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:38.998898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:39.000479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:39.001071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:39.148707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:39.150062 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:39.157091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:39.160230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:39.161115 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:39.161993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:39.163148 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:39.163899 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:39.164687 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:40.058975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:40.073074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d8971e24-7ebd-4239-9019-844511d9396f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 1.106906 Aug 30 16:01:40.077605 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 180/363] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:38 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:40.237736 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:40.238607 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2120479085", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6af5c446-333d-462f-8134-9c2082da6195"}], "security_groups": [{"name": "tempest-securitygroup--549718391"}], "key_name": "tempest-keypair-1283955912", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:40.251104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:40.252811 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:40.257180 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a09b2edc-934c-40ea-bd2d-9fc01a09e767 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 1.112903 Aug 30 16:01:40.258365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 184/364] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:39 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 1115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:40.488876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] validate_networks() for [('6af5c446-333d-462f-8134-9c2082da6195', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:01:40.946255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:41.072567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2aefc9f4-a8f6-434c-a8e1-1f2abb0fc497 req-84b413bf-7a49-4cc6-b8d5-3542270078cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "096b49e4-be8b-48c6-88a3-19b6a555ff37", "tag": "6b029260-3e6c-4a95-bbdd-4563d871c661"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:41.094914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2aefc9f4-a8f6-434c-a8e1-1f2abb0fc497 req-84b413bf-7a49-4cc6-b8d5-3542270078cd service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.095419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2aefc9f4-a8f6-434c-a8e1-1f2abb0fc497 req-84b413bf-7a49-4cc6-b8d5-3542270078cd service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.095851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2aefc9f4-a8f6-434c-a8e1-1f2abb0fc497 req-84b413bf-7a49-4cc6-b8d5-3542270078cd service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.133792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2aefc9f4-a8f6-434c-a8e1-1f2abb0fc497 req-84b413bf-7a49-4cc6-b8d5-3542270078cd service nova] Creating event network-changed:6b029260-3e6c-4a95-bbdd-4563d871c661 for instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 on hv-cinder-85505 Aug 30 16:01:41.145187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2aefc9f4-a8f6-434c-a8e1-1f2abb0fc497 req-84b413bf-7a49-4cc6-b8d5-3542270078cd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.076369 Aug 30 16:01:41.150233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 185/365] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:01:41.157255 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:41.165523 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:41.184516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.185379 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.185833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.186572 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.187030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.187457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.407081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:01:41.407636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:01:41.407966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:01:41.408373 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:01:41.409077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:01:41.424460 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.425017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.425526 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.426325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.426783 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.427208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.476546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:41.495275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Getting quotas for user c34836a75f144f74aa3fd6a38ccb9791 and project 10a598aa5be54fc29948da53d8ac7a32. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:41.505796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:41.518928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d854ee5-b544-4187-acad-b31d9a77983b tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.369259 Aug 30 16:01:41.522417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 186/366] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:41 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:41.534372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:41.535329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:41.542548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:01:41.549530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:01:41.554215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.555057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.555720 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.557116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:41.559389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:41.560103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:41.695470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-969b14fd-65e8-4cad-b5c1-3182e3df0a5d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.463730 Aug 30 16:01:41.697997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 181/367] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:01:40 2022] POST /compute/v2.1/servers => generated 408 bytes in 1467 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:01:41.710749 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dfe388dd-705a-48bb-ba66-6b99859e428d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:41.712222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dfe388dd-705a-48bb-ba66-6b99859e428d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:41.840618 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dfe388dd-705a-48bb-ba66-6b99859e428d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:41.851293 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dfe388dd-705a-48bb-ba66-6b99859e428d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1246 microversion: 2.1 time: 0.146055 Aug 30 16:01:41.852051 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 182/368] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:41 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1246 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:41.889716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:41.902225 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:41.910573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:41.912359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-72bf26cd-001a-43e4-a47f-0f27c341e3a6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.388326 Aug 30 16:01:41.913683 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 187/369] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:41 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:42.543179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:42.543940 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:42.556767 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:42.558667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:42.559139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:42.561330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:42.561908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:42.563152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:42.874691 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:42.877160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:42.893781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:42.912754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:42.921233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:42.923017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-520f2afd-8936-4e7f-9aae-54dfbe70abc2 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.384731 Aug 30 16:01:42.924207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.029s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:42.926559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:42.927207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:42.927660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 183/370] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:42 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:42.928383 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:42.946974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:42.948072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:42.972883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:42.973400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:42.976004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:42.976926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:42.979211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:42.979837 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:43.063080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:43.071614 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d4400af-fcb2-4d3a-ac69-50312b5ed664 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1242 microversion: 2.1 time: 0.202047 Aug 30 16:01:43.084964 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 188/371] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:42 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1242 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:43.383824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:43.397680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:43.404371 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:43.411133 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-88620ff2-0966-4c94-a6ff-aa5ead64297d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.469844 Aug 30 16:01:43.411917 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 184/372] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:42 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:43.959528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:43.960372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:43.983265 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:43.983764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:43.984196 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:43.987985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:43.992017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:43.993037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:44.094365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:44.095986 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:44.112682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:44.113645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:44.114619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:44.118727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:44.119627 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:44.120534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:44.372244 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:44.388718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f0fae6da-3673-4077-a90f-9773d7546c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1306 microversion: 2.1 time: 0.298697 Aug 30 16:01:44.438796 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 185/373] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:44 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1306 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:44.468061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:44.474316 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:44.487819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:44.488327 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:44.488754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:44.496554 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:44.501560 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:44.502050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:44.521962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:44.531716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31a22340-02f5-41c5-923a-b3240f93ee20 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.584580 Aug 30 16:01:44.556778 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 189/374] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:43 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:44.849765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:44.861366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:44.863424 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:44.864819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fb8703e2-172f-4371-a054-ef7c62e1b64f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.420892 Aug 30 16:01:44.866172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 186/375] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:44 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:45.422467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:45.423331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:45.427735 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=12 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:45.449134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.450443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.452292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.454378 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.454999 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.460350 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.557064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:45.558994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:45.573158 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.574022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.575766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.576624 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.578100 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.579377 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.593425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:45.601813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cdf2f1c7-3c4d-4fd1-aaef-70bd7984fbf5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1304 microversion: 2.1 time: 0.183280 Aug 30 16:01:45.602402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 190/376] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:45 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1304 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:45.709609 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-7b36cd81-6a25-4593-b1a7-d8897d55d084 req-eb525c04-f063-4168-95b0-9b726820bef6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57693244-648a-492d-a8a0-461cdeff222a", "name": "network-vif-plugged", "status": "completed", "tag": "9c19c80b-3f6c-47e9-ab99-a9cf1b0f4057"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:45.730975 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7b36cd81-6a25-4593-b1a7-d8897d55d084 req-eb525c04-f063-4168-95b0-9b726820bef6 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.733535 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7b36cd81-6a25-4593-b1a7-d8897d55d084 req-eb525c04-f063-4168-95b0-9b726820bef6 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.733535 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-7b36cd81-6a25-4593-b1a7-d8897d55d084 req-eb525c04-f063-4168-95b0-9b726820bef6 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.764580 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-7b36cd81-6a25-4593-b1a7-d8897d55d084 req-eb525c04-f063-4168-95b0-9b726820bef6 service nova] Creating event network-vif-plugged:9c19c80b-3f6c-47e9-ab99-a9cf1b0f4057 for instance 57693244-648a-492d-a8a0-461cdeff222a on hv-cinder-85505 Aug 30 16:01:45.780578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-7b36cd81-6a25-4593-b1a7-d8897d55d084 req-eb525c04-f063-4168-95b0-9b726820bef6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074833 Aug 30 16:01:45.784086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 191/377] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:01:45.890924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:45.893725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:45.905056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.905718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.906767 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.907974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:45.908718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:45.909254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:45.935617 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:45.949407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd9bbb2a-1a09-4985-9d80-5d78512b4702 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.393964 Aug 30 16:01:45.950899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 187/378] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:45 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:46.411901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:46.430725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:46.432210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:46.455207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5a8f95b9-3601-43ea-863d-a6e3b601c21c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.569216 Aug 30 16:01:46.457680 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 192/379] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:45 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:46.623602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:46.625864 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:46.661155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:46.663680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:46.664340 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:46.665876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:46.667479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:46.668103 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:46.901022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:46.916496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-defdfa88-21cf-41d6-88bd-5bfaa8d74da8 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.296999 Aug 30 16:01:46.917150 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 188/380] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:46 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:46.971072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:46.971741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:46.980425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:46.981263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:46.982061 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:46.982771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:46.983284 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:46.983706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:47.294356 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:47.303416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-363a9203-6f18-4e15-b605-23f93df2eeac tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1314 microversion: 2.1 time: 0.336451 Aug 30 16:01:47.306243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 193/381] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:46 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:47.486316 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:47.487659 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:47.505911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:47.506694 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:47.507382 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:47.508294 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:47.508953 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:47.509668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:47.858703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:47.883750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:47.887492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:47.888736 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-49548edc-0fbc-4c0f-8476-74e2817c0011 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.408467 Aug 30 16:01:47.893707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 189/382] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:47 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:47.941137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:47.947676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:47.955603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:47.956541 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:47.957396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:47.958750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:47.959425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:47.960724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:48.204139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:48.212120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ceec8aa8-f6fd-4b1e-a6d7-1c885a5e37ad tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.276755 Aug 30 16:01:48.229825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 190/383] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:47 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:48.234739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-83179b64-35ec-48b4-b209-f90052a746ec req-53df2e10-3337-46d5-b7f9-263306ffa852 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b410390-11de-461d-ae41-a8f036f5d694", "tag": "7fb957c8-4f9b-4421-b9ac-197b68f7a10e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:48.278154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-83179b64-35ec-48b4-b209-f90052a746ec req-53df2e10-3337-46d5-b7f9-263306ffa852 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:48.283015 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-83179b64-35ec-48b4-b209-f90052a746ec req-53df2e10-3337-46d5-b7f9-263306ffa852 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:48.283495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-83179b64-35ec-48b4-b209-f90052a746ec req-53df2e10-3337-46d5-b7f9-263306ffa852 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:48.300257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-83179b64-35ec-48b4-b209-f90052a746ec req-53df2e10-3337-46d5-b7f9-263306ffa852 service nova] Creating event network-changed:7fb957c8-4f9b-4421-b9ac-197b68f7a10e for instance 6b410390-11de-461d-ae41-a8f036f5d694 on hv-cinder-85505 Aug 30 16:01:48.305390 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-83179b64-35ec-48b4-b209-f90052a746ec req-53df2e10-3337-46d5-b7f9-263306ffa852 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074161 Aug 30 16:01:48.306049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 191/384] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:48.353830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:48.354572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:48.363153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:48.363632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:48.364464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:48.365936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:48.366718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:48.367305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:48.397409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:48.610229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0cb29a74-18cf-4c6f-9754-435254284538 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Action: 'create', calling method: .version_select at 0x7f48482b2310>, body: {"keypair": {"name": "tempest-TestShelveInstance-247566484", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMekJVgZYHbmyz9g/Tc7khdUKMUsCuGnrS+h8A/wRuYcI98rPcTW/RAnXMMx5aW9iteMehyJ7g7uO+N+nwn1EkD3mArFZq+GtFgNPgGjuw4PCV5Lt1JvmTUwMXQWhyTNHw=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:48.659415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:48.661310 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-0cb29a74-18cf-4c6f-9754-435254284538 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Getting quotas for project 340ea9b1270443f58c051cfb5699caa5. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:01:48.669810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-0cb29a74-18cf-4c6f-9754-435254284538 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Getting quotas for user 4f00011535aa4836b1cc410dd5d97beb and project 340ea9b1270443f58c051cfb5699caa5. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:01:48.670228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-11847936-1ea5-4058-9ca5-609059a6c755 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1498 microversion: 2.1 time: 0.332169 Aug 30 16:01:48.671190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 192/385] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:48 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1498 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:48.736167 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0cb29a74-18cf-4c6f-9754-435254284538 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.814330 Aug 30 16:01:48.736598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 194/386] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:01:47 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:48.914780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:48.916119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:48.945486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:48.946067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:48.947329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:48.950118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:48.950845 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:48.951426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.238168 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:49.238781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:49.263706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:49.266871 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:49.268806 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.270592 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:49.271531 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:49.273941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.280075 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:49.298203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:49.300193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:49.301937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8b15f922-658a-4f45-b4c5-8419bacc8c54 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.393563 Aug 30 16:01:49.303076 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 193/387] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:48 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:49.477093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:49.477994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:49.487925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:49.488727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:49.489791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.490991 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:49.491669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:49.492349 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.531818 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:01:49.692746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-624aa558-90cf-4afe-aec5-bb5d001f405a tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "DELETE /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 204 len: 0 microversion: 2.1 time: 0.219838 Aug 30 16:01:49.698004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 194/388] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:01:49 2022] DELETE /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 0 bytes in 222 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:01:49.706501 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:49.707720 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:49.708629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:49.716683 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-192ad564-1cf3-4142-918d-d14d96c6c98a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.482556 Aug 30 16:01:49.717352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 195/389] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:49 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:49.718878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:49.725669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:49.726389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.727351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:49.727997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:49.728654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:49.949398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:49.961821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4a47d88e-a957-4e73-bbe3-5547598981c3 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1504 microversion: 2.1 time: 0.261000 Aug 30 16:01:49.962769 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 195/390] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:49 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1504 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:50.328355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:50.329902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:50.337401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:50.338128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:50.339354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:50.341803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:50.342278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:50.342796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:50.600680 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:50.611408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:50.650286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:50.662743 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:50.670707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-361e72ed-63f5-4ae3-8a98-09d8518d68dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.348729 Aug 30 16:01:50.694279 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 196/391] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:50 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:50.751031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:50.751655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:50.817467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:50.817998 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:50.818433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:50.819143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:50.819596 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:50.820011 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:50.985443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:50.986443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:51.001075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:51.001621 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:51.002048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:51.002753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:51.003213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:51.003610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:51.248219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:51.261040 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1bedea63-d0f4-48fa-a38d-a1629e2eedf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.522981 Aug 30 16:01:51.262591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 196/392] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:50 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:51.301968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:51.318631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b6298c16-a6e5-47f8-b8de-02de930bcbcb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1504 microversion: 2.1 time: 0.338550 Aug 30 16:01:51.319774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 197/393] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:50 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1504 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:51.703261 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:51.704152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:51.706386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:51.717918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:51.721978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:51.722701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:51.723455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:51.723925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:51.724360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:51.847343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:51.913085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:51.930805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:51.932233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:51.933643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cab3ae9b-d7ef-4e72-a85b-ce12e61ea3ef tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.234427 Aug 30 16:01:51.934676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 197/394] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:51 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:52.290200 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:52.291928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:52.314392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:52.315418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:52.318182 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:52.319200 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:52.320786 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:52.321827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:52.360231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:52.365696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:52.383846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:52.394092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:52.394817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:52.395733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:52.397375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:52.397980 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:52.796659 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:52.808833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e585d5bb-cb02-4670-a214-69f019ed2055 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1504 microversion: 2.1 time: 0.471518 Aug 30 16:01:52.816447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 198/395] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:52 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1504 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:52.895762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:52.913940 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-837bff57-0894-46af-aad5-7019a8a39ca6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.631595 Aug 30 16:01:52.914856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 198/396] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:52 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:52.958525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:52.959787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:52.973681 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:52.974512 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:52.975179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:52.976091 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:52.976688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:52.977290 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.245402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:53.254122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:53.255924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:53.263951 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ef8be53a-d4d0-402b-8ae3-b89f5e26622a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.309571 Aug 30 16:01:53.280220 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 199/397] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:52 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:53.637262 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-d4b26478-7558-4da5-94f4-66ce69f3fbb9 req-4ab84f62-4a58-46d3-903c-71b62a35127e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57693244-648a-492d-a8a0-461cdeff222a", "name": "network-vif-deleted", "tag": "9c19c80b-3f6c-47e9-ab99-a9cf1b0f4057"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:53.668260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d4b26478-7558-4da5-94f4-66ce69f3fbb9 req-4ab84f62-4a58-46d3-903c-71b62a35127e service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.671782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d4b26478-7558-4da5-94f4-66ce69f3fbb9 req-4ab84f62-4a58-46d3-903c-71b62a35127e service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.672402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-d4b26478-7558-4da5-94f4-66ce69f3fbb9 req-4ab84f62-4a58-46d3-903c-71b62a35127e service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.691673 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-d4b26478-7558-4da5-94f4-66ce69f3fbb9 req-4ab84f62-4a58-46d3-903c-71b62a35127e service nova] Creating event network-vif-deleted:9c19c80b-3f6c-47e9-ab99-a9cf1b0f4057 for instance 57693244-648a-492d-a8a0-461cdeff222a on hv-cinder-85505 Aug 30 16:01:53.699837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-d4b26478-7558-4da5-94f4-66ce69f3fbb9 req-4ab84f62-4a58-46d3-903c-71b62a35127e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074480 Aug 30 16:01:53.701681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 199/398] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:53.813789 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d10cda7e-e194-4ab8-8805-379638c6d282 req-58aaec2b-8fab-429a-8698-d646e46f15bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b410390-11de-461d-ae41-a8f036f5d694", "name": "network-vif-plugged", "status": "completed", "tag": "7fb957c8-4f9b-4421-b9ac-197b68f7a10e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:53.835289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d10cda7e-e194-4ab8-8805-379638c6d282 req-58aaec2b-8fab-429a-8698-d646e46f15bd service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.836070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d10cda7e-e194-4ab8-8805-379638c6d282 req-58aaec2b-8fab-429a-8698-d646e46f15bd service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.836657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d10cda7e-e194-4ab8-8805-379638c6d282 req-58aaec2b-8fab-429a-8698-d646e46f15bd service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.846943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:53.847957 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:53.861004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.861521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.864772 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.865718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.868679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d10cda7e-e194-4ab8-8805-379638c6d282 req-58aaec2b-8fab-429a-8698-d646e46f15bd service nova] Creating event network-vif-plugged:7fb957c8-4f9b-4421-b9ac-197b68f7a10e for instance 6b410390-11de-461d-ae41-a8f036f5d694 on hv-cinder-85505 Aug 30 16:01:53.869426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.870031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.879835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d10cda7e-e194-4ab8-8805-379638c6d282 req-58aaec2b-8fab-429a-8698-d646e46f15bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071966 Aug 30 16:01:53.884763 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 200/399] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:53.925429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.926663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.927429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.928102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lazy-loading 'fault' on Instance uuid 57693244-648a-492d-a8a0-461cdeff222a {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:01:53.935717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:53.936931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:53.945866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.946953 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.947595 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:53.948499 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:53.949136 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:53.949784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:54.014172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:54.034798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5d708864-7fec-44e6-b3c3-6d3acd49f1bb tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1304 microversion: 2.1 time: 0.191412 Aug 30 16:01:54.035542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 200/400] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:53 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1304 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:54.184573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:54.195872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4dfda739-d4aa-4723-9842-bc4b481b2892 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.264597 Aug 30 16:01:54.213547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 201/401] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:53 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:01:54.293877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:54.294864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:54.311765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:54.312265 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:54.316371 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:54.317146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:54.317666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:54.318127 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:54.782134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:54.790675 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:54.792070 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:54.793487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bec1dd2-e128-43d2-9fa7-aa16dc5a37bf tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.508651 Aug 30 16:01:54.793879 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 201/402] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:54 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:01:55.056032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:55.056667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:55.063081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.063556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.064181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.064878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.065357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.065949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.101313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.102106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.102651 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.103433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lazy-loading 'fault' on Instance uuid 57693244-648a-492d-a8a0-461cdeff222a {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:01:55.154122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9fdf5c5f263474bb41ab41bdac6f78f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '80493f357d57418cb58f8a33e82b8822', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:55.162088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b9cab196-7e6e-410b-9be3-bc8f403c2915 tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 200 len: 1304 microversion: 2.1 time: 0.110115 Aug 30 16:01:55.163004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 202/403] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:55 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:55.222430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:55.223321 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:55.233155 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.234007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.234595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.236165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.237298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.237872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.375910 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:55.384301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-398e5f43-7dd5-453c-9345-bccad359f22f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1371 microversion: 2.1 time: 0.166642 Aug 30 16:01:55.384898 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 202/404] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:55 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:55.818048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:55.818821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:55.827165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.827657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.828087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.828933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:55.829422 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:55.829833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:55.983007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:55.992510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:55.995729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:55.998022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e6c36c22-b10d-480f-8d12-31887fc3e02f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1739 microversion: 2.20 time: 0.185105 Aug 30 16:01:56.014135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 203/405] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:55 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:56.251060 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:56.251854 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] [instance: 57693244-648a-492d-a8a0-461cdeff222a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:56.262791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:56.263572 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:56.264226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:56.265298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:56.265958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:56.266546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:56.282106 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] HTTP exception thrown: Instance 57693244-648a-492d-a8a0-461cdeff222a could not be found. Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Request method failure captured: Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a HTTP/1.1 Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjQ62J1LknOESrx2Xz5Ckc13FqnX_AEo9w5XVRrVZMVIb-5qMpEqEkwZ1f10YrSjZhGEYfx1N8ZSP7KZrcfCAhv6SB_f7LhNYxV8NdSP08n3OhEZIY8-YhqFMvbgz836xcbyLlImHH2FKgmRmxZbJ_U8PpRo3fWJ_EyjsFp8rr7DalY Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 80493f357d57418cb58f8a33e82b8822 Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesActionsTest-1539826875 Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:01:56.283737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80493f357d57418cb58f8a33e82b8822"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/80493f357d57418cb58f8a33e82b8822"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/80493f357d57418cb58f8a33e82b8822"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_80493f357d57418cb58f8a33e82b8822"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesActionsTest-1539826875 Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 80493f357d57418cb58f8a33e82b8822 Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesActionsTest-1539826875 Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesActionsTest-1539826875-project Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: e9fdf5c5f263474bb41ab41bdac6f78f Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesActionsTest-1539826875-project Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 57693244-648a-492d-a8a0-461cdeff222a could not be found. Aug 30 16:01:56.285304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '57693244-648a-492d-a8a0-461cdeff222a'} Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57693244-648a-492d-a8a0-461cdeff222a could not be found. Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:01:56.289838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57693244-648a-492d-a8a0-461cdeff222a could not be found. Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57693244-648a-492d-a8a0-461cdeff222a could not be found. Aug 30 16:01:56.291349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:01:56.292554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] Returning 404 to user: Instance 57693244-648a-492d-a8a0-461cdeff222a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:01:56.292554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9fa6086-44ed-40e0-a423-e1e928acab7f tempest-VolumesActionsTest-1539826875 tempest-VolumesActionsTest-1539826875-project] 10.222.0.20 "GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a" status: 404 len: 111 microversion: 2.1 time: 0.040641 Aug 30 16:01:56.292554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 203/406] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:56 2022] GET /compute/v2.1/servers/57693244-648a-492d-a8a0-461cdeff222a => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:01:56.405014 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:56.405646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:56.412417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:56.413086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:56.413753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:56.414456 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:56.414886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:56.415485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:56.562293 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:56.571821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85117af6-bc80-47e7-95cb-ddb9ece2c8e6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1565 microversion: 2.1 time: 0.170531 Aug 30 16:01:56.572407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 204/407] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:01:56 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1565 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:01:56.591885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:56.593759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:56.602157 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:56.602715 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:56.603213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:56.604041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:56.604558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:56.605183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:56.697117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2084373e-8806-42c7-90cb-027dfe179535 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.108582 Aug 30 16:01:56.697771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 204/408] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:01:56 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-interface => generated 285 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:57.036250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:57.036885 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:57.049642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:57.050242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:57.050747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:57.051516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:57.052417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:57.052895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:57.269799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:57.278346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:57.279770 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:57.280923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eb9270f1-12c4-4493-b69c-0ed17f4f9ba9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1721 microversion: 2.20 time: 0.248623 Aug 30 16:01:57.281490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 205/409] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:57 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1721 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:57.728397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bdad39ab-fad8-40a0-b08a-b5e4042fbe52 req-5006027a-096c-43e4-8ad1-93be2f85afbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b410390-11de-461d-ae41-a8f036f5d694", "tag": "7fb957c8-4f9b-4421-b9ac-197b68f7a10e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:57.739566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bdad39ab-fad8-40a0-b08a-b5e4042fbe52 req-5006027a-096c-43e4-8ad1-93be2f85afbf service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:57.740162 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bdad39ab-fad8-40a0-b08a-b5e4042fbe52 req-5006027a-096c-43e4-8ad1-93be2f85afbf service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:57.740657 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bdad39ab-fad8-40a0-b08a-b5e4042fbe52 req-5006027a-096c-43e4-8ad1-93be2f85afbf service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:57.752487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bdad39ab-fad8-40a0-b08a-b5e4042fbe52 req-5006027a-096c-43e4-8ad1-93be2f85afbf service nova] Creating event network-changed:7fb957c8-4f9b-4421-b9ac-197b68f7a10e for instance 6b410390-11de-461d-ae41-a8f036f5d694 on hv-cinder-85505 Aug 30 16:01:57.763513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bdad39ab-fad8-40a0-b08a-b5e4042fbe52 req-5006027a-096c-43e4-8ad1-93be2f85afbf service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040033 Aug 30 16:01:57.764865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 205/410] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:01:58.305095 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:58.305687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:58.312934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:58.313595 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:58.314066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:58.314829 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:58.315447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:58.316023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:58.458608 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:58.467164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:58.468603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:58.469801 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a2054838-c7dd-40fc-81f8-759d750700ed tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1721 microversion: 2.20 time: 0.169208 Aug 30 16:01:58.470366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 206/411] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:58 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:01:59.490714 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:01:59.496081 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:01:59.497147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:01:59.504346 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:59.504828 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:59.505436 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:59.506135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:59.506578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:59.507057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:59.539513 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-73feb1ac-f6d0-4c3f-b38c-22675904e898 req-c8c83be5-fb4c-4bbd-8210-f3211d09f018 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "name": "network-vif-unplugged", "status": "completed", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:01:59.550573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-73feb1ac-f6d0-4c3f-b38c-22675904e898 req-c8c83be5-fb4c-4bbd-8210-f3211d09f018 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:01:59.551059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-73feb1ac-f6d0-4c3f-b38c-22675904e898 req-c8c83be5-fb4c-4bbd-8210-f3211d09f018 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:01:59.551521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-73feb1ac-f6d0-4c3f-b38c-22675904e898 req-c8c83be5-fb4c-4bbd-8210-f3211d09f018 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:01:59.568151 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-73feb1ac-f6d0-4c3f-b38c-22675904e898 req-c8c83be5-fb4c-4bbd-8210-f3211d09f018 service nova] Creating event network-vif-unplugged:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 16:01:59.573954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-73feb1ac-f6d0-4c3f-b38c-22675904e898 req-c8c83be5-fb4c-4bbd-8210-f3211d09f018 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038067 Aug 30 16:01:59.574883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 207/412] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:01:59.716530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:59.725385 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:59.727242 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:01:59.728712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-009dff2d-5a02-4fdd-822b-800263772637 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1721 microversion: 2.20 time: 0.238999 Aug 30 16:01:59.732804 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 206/413] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:01:59 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1721 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:00.757260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:00.758071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:00.766795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:00.767278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:00.767703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:00.768410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:00.768852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:00.769273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:00.773923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:00.918729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:00.927001 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:00.928418 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:00.929589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d7e15cc5-33cc-4f2b-bc52-628451f057ca tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1664 microversion: 2.20 time: 0.177200 Aug 30 16:02:00.930139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 208/414] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:00 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1664 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:00.952858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e816ad9-9d9a-4535-b608-c898fc1fb096"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:00.955543 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:00.963089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:00.963583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:00.963991 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:00.964732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:00.965179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:00.965636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:01.325711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-886ce312-9108-4894-8fab-8fe2564e5e8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.377669 Aug 30 16:02:01.326269 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 207/415] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Aug 30 16:02:00 2022] POST /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments => generated 188 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:02:01.500558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:01.501513 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:01.509890 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:01.510359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:01.510949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:01.511719 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:01.512207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:01.512747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:01.559148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120696) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 16:02:01.636487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-33f8616c-1aae-47cb-b356-48485d1514c7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/action" status: 202 len: 0 microversion: 2.20 time: 0.142081 Aug 30 16:02:01.637099 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 209/416] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 30 16:02:01 2022] POST /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/action => generated 0 bytes in 144 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:01.645607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:01.646288 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:01.653372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:01.653832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:01.654261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:01.654984 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:01.655430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:01.655866 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:01.803881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:01.812485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:01.813944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:01.815367 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ce54411-cb00-456e-aa4a-6498baedbfa1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1750 microversion: 2.20 time: 0.173554 Aug 30 16:02:01.816019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 208/417] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:01 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1750 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:02.840012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:02.840581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:02.847337 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:02.847821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:02.848253 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:02.848938 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:02.849435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:02.849858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:02.983514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:02.993413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:02.994839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:02.996049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-95f1a4d8-535c-4196-a3d1-23d3c1b7ca38 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1750 microversion: 2.20 time: 0.161317 Aug 30 16:02:02.996602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 210/418] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:02 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1750 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:04.019669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:04.020298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:04.027486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:04.027970 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:04.028404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:04.029103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:04.029574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:04.029996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:04.171765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:04.181013 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:04.182484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:04.183632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-49233845-8633-4b57-9421-41646e825ac4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1750 microversion: 2.20 time: 0.167956 Aug 30 16:02:04.184185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 209/419] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:04 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1750 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:05.205773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:05.206348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:05.212755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:05.213329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:05.213758 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:05.214449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:05.214896 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:05.215322 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:05.352125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:05.361925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:05.363567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:05.364566 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a67947c8-1119-4ba2-9ba4-8f1c16f402dd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1750 microversion: 2.20 time: 0.162893 Aug 30 16:02:05.365018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 211/420] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:05 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1750 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:06.391310 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:06.392347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:06.395434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=76,nova_api:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:06.403178 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:06.403663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:06.404099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:06.404790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:06.405233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:06.405681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:06.540059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:06.551083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:06.552550 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:06.553751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7bc0b588-6f22-4ab8-9004-b62750df2eb5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1750 microversion: 2.20 time: 0.169281 Aug 30 16:02:06.554313 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 210/421] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:06 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1750 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:07.580410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:07.581133 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:07.590175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:07.590691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:07.591228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:07.592080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:07.592637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:07.593163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:07.730145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:07.739558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:07.740992 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:07.742178 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-370663e9-b9af-4c24-9b21-2c7c94e38efc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1750 microversion: 2.20 time: 0.166842 Aug 30 16:02:07.742758 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 212/422] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:07 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1750 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:08.765586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:08.766218 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:08.772743 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:08.773206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:08.773663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:08.774351 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:08.774797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:08.775215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:08.910395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:08.919427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:08.920955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:08.922439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0cdec988-478e-4219-b6e7-24ad5e211e4c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1752 microversion: 2.20 time: 0.160885 Aug 30 16:02:08.923083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 211/423] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:08 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1752 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:09.948698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:09.949417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:09.957592 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:09.958339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:09.959031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:09.960135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:09.960646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:09.961192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:10.112946 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:10.123141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:10.124845 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:10.126184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ce2dabc2-98aa-45c4-8b01-827e153eeeee tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1752 microversion: 2.20 time: 0.182578 Aug 30 16:02:10.126844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 213/424] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:09 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1752 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:11.150808 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:11.151626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:11.163066 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:11.165170 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:11.165857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:11.167034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:11.167711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:11.168816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:11.374838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:11.378971 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:11.385005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:11.387948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:11.389253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2fd7d26-72c2-44f1-8fb7-c0925ded178c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.242937 Aug 30 16:02:11.390052 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 212/425] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:11 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:12.412138 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:12.413426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:12.416427 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:12.422130 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:12.422833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:12.423255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:12.423944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:12.424549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:12.424964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:12.573146 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:12.582447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:12.584262 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:12.585469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5fab9a3d-2050-48f0-9418-f56ccba2a65f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.177260 Aug 30 16:02:12.589207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 214/426] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:12 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:13.608959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:13.609754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:13.618429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:13.619166 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:13.619689 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:13.620493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:13.620948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:13.621397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:13.774527 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:13.784514 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:13.786059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:13.787215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bab11da8-57d4-4d73-8c9e-709d781e1c20 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.182649 Aug 30 16:02:13.787775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 213/427] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:13 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:14.810922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:14.811619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:14.818537 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:14.819010 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:14.819431 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:14.820117 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:14.820565 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:14.820961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:14.983339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:14.999349 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:15.001077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:15.002567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5230de5f-e9e2-4adb-956b-33000ffb6863 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.195608 Aug 30 16:02:15.018144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 215/428] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:14 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:16.029027 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:16.030108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:16.038948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:16.040027 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:16.040586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:16.041447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:16.041900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:16.042527 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:16.184509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:16.195433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:16.197263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:16.198689 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-774678ac-d523-49be-b3e7-e3284b078c67 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.174957 Aug 30 16:02:16.199372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 214/429] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:16 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:17.225597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:17.226227 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:17.235366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:17.235990 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:17.236962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:17.237709 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:17.238475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:17.239174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:17.399872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:17.410828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:17.412718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:17.414200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3b1c16fa-b4c8-43e1-9399-4b25f3c02d3f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.195871 Aug 30 16:02:17.415568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 216/430] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:17 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:18.437511 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:18.438339 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:18.445037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:18.445557 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:18.445993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:18.446676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:18.447123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:18.447537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:18.597998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:18.611495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:18.612931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:18.614124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c9c943f1-1d22-4ae0-97ce-426df4d765ae tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.180788 Aug 30 16:02:18.614689 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 215/431] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:18 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:19.639292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:19.649307 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:19.665644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:19.667286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:19.668364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:19.670107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:19.672692 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:19.673548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:19.955026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:19.968689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:19.970878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:19.975805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2c6ef5f2-d9f3-4e3b-afd3-cd4bbe3be412 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.341981 Aug 30 16:02:19.976643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 217/432] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:19 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:21.006906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:21.008298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:21.031623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:21.032269 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:21.032757 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:21.033615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:21.035835 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:21.037774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:21.225318 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:21.237298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:21.243773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:21.245406 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ab7dea67-2df8-440a-b3e3-ae4242f4f24f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.242566 Aug 30 16:02:21.247083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 216/433] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:21 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:22.297956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:22.306049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:22.335860 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:22.340103 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:22.342299 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:22.345559 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:22.348348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:22.352324 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:22.663047 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:22.673360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:22.675081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:22.676899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-78829bdf-d221-4ddc-8641-5a37ec2324b3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.392343 Aug 30 16:02:22.695973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 218/434] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:22 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:23.704314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:23.706018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:23.719973 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:23.720928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:23.721574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:23.722352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:23.722810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:23.723234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:23.891997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:23.902770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:23.904868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:23.906971 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1d6cffa1-4956-4e70-8c37-af494f248c32 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.206237 Aug 30 16:02:23.907862 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 217/435] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:23 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:24.934753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:24.939829 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:24.948602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:24.949591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:24.950376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:24.951378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:24.952053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:24.952680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:25.190536 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:25.209715 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:25.212997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:25.215486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ff5bfa8-0738-44a2-8ad8-c951d5a8c42c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.284533 Aug 30 16:02:25.234726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 219/436] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:24 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:26.240455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:26.241071 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:26.258342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:26.261892 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:26.262578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:26.266347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:26.267268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:26.268733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:26.514285 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:26.526737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:26.528605 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:26.530435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b33f71ba-404a-43ac-a768-dcb1f36a2156 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.294805 Aug 30 16:02:26.532808 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 218/437] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:26 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:27.554100 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:27.555485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:27.562375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:27.563041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:27.563534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:27.564346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:27.564880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:27.565389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:27.714923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:27.726094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:27.727838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:27.729232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3d425739-bc90-45a5-8e54-3df9465ada25 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.179349 Aug 30 16:02:27.745330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 220/438] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:27 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:28.753170 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:28.754707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:28.773084 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:28.774374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:28.774820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:28.775550 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:28.775998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:28.776414 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:28.967767 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:28.979732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:28.982269 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:28.984517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e000641-9687-49f8-aa28-32a20ba43883 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.235594 Aug 30 16:02:29.006273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 219/439] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:28 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:30.008145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:30.009249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:30.015890 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:30.016392 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:30.016826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:30.017616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:30.018244 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:30.018838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:30.179482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:30.192883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:30.195184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:30.204503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0101ebe7-9d98-4012-9e14-b84860bc61da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.200127 Aug 30 16:02:30.206016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 221/440] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:30 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:31.234555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:31.235455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:31.243170 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:31.243663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:31.244090 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:31.244774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:31.245239 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:31.245665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:31.389295 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:31.402775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:31.405011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:31.406787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9f58d30c-9add-4c09-9633-8d4b665583e1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.178604 Aug 30 16:02:31.407635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 220/441] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:31 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:32.430607 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:32.431214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:32.437798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:32.438275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:32.438700 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:32.439383 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:32.439832 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:32.440300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:32.444265 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:32.581783 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:32.592209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:32.594033 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:32.595672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-520fa273-5685-4722-b089-88a6efdac236 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.169030 Aug 30 16:02:32.596429 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 222/442] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:32 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:33.618879 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:33.620192 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:33.634723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:33.635483 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:33.637702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:33.638427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:33.639037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:33.641796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:33.841089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:33.849912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:33.851461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:33.852721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9e52eed6-a931-4741-92b3-15d2805938f3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.238120 Aug 30 16:02:33.853458 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 221/443] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:33 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:34.876838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:34.877419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:34.884397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:34.884889 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:34.885355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:34.886285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:34.886741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:34.887164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:35.073773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:35.082836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:35.084339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:35.085603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c262246a-21f7-4ba8-a5f5-72425e9901f7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.213248 Aug 30 16:02:35.086257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 223/444] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:34 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:35.828575 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-433475166", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-247566484", "security_groups": [{"name": "tempest-secgroup-smoke-1144182338"}], "networks": [{"uuid": "9c692ce6-9d14-42bc-8731-2738d35f9af1"}], "block_device_mapping_v2": [{"uuid": "d9ee0a08-4208-465b-9aaa-eb518ee0b70a", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:35.943316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] validate_networks() for [('9c692ce6-9d14-42bc-8731-2738d35f9af1', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:02:36.108702 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:36.111390 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:36.119249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:36.119729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:36.120323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:36.121249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:36.121734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:36.122155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:36.621531 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:36.630873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:36.632529 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:36.633895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-af6385ee-8277-4597-95c7-960931239da4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.529727 Aug 30 16:02:36.634455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 224/445] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:36 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:36.666688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:02:36.667101 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:02:36.667651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:02:36.668048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:02:36.668447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:02:36.670435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=28 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:36.678604 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:36.679074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:36.679496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:36.680309 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:36.680759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:36.681172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:36.697532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Getting quotas for project 340ea9b1270443f58c051cfb5699caa5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:02:36.701519 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Getting quotas for user 4f00011535aa4836b1cc410dd5d97beb and project 340ea9b1270443f58c051cfb5699caa5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:02:36.759848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:02:36.762047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='d9ee0a08-4208-465b-9aaa-eb518ee0b70a',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:02:36.901332 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe94c4a7-78a6-495e-98c9-03f915230453 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.076744 Aug 30 16:02:36.901980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 222/446] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:02:35 2022] POST /compute/v2.1/servers => generated 406 bytes in 1078 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:02:36.912672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6eb113eb-04a8-4a3a-89f7-cb8537927ce6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:36.913297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6eb113eb-04a8-4a3a-89f7-cb8537927ce6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:36.964682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6eb113eb-04a8-4a3a-89f7-cb8537927ce6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:36.971576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6eb113eb-04a8-4a3a-89f7-cb8537927ce6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1087 microversion: 2.1 time: 0.062716 Aug 30 16:02:36.972159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 225/447] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:36 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1087 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:37.657564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:37.658168 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:37.664237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:37.664711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:37.665145 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:37.665860 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:37.666302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:37.666719 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:37.805849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:37.815366 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:37.818247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:37.819420 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b837c48-6960-4588-a089-efe083d1ea05 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.165955 Aug 30 16:02:37.819985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 223/448] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:37 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:37.993677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:37.994232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:38.001734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:38.002213 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:38.002637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:38.003324 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:38.003768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:38.004185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:38.065272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:38.073252 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dc7c499f-cad9-4872-aefa-0cc578be2be5 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1185 microversion: 2.1 time: 0.083798 Aug 30 16:02:38.073843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 226/449] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:37 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1185 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:38.842689 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:38.843246 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:38.850965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:38.851673 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:38.851917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:38.852941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:38.853434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:38.853848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:38.987671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:38.996805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:38.998279 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:38.999447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8818cdd2-53c8-44f1-8677-7310c939557f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.160790 Aug 30 16:02:39.000006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 224/450] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:38 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:39.094583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:39.095210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:39.102348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:39.102871 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:39.103374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:39.104107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:39.104612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:39.105036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:39.173797 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:39.181795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0b39b94d-4614-491a-b8eb-2585dd5f5eed tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1185 microversion: 2.1 time: 0.091235 Aug 30 16:02:39.182367 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 227/451] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:39 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1185 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:40.022740 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:40.023379 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:40.029737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:40.030215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:40.030640 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:40.031326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:40.031767 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:40.032166 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:40.203695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:40.204428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:40.217708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:40.218225 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:40.218664 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:40.221646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:40.222098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:40.222678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:40.390492 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:40.399522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:40.400961 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:40.402418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a53ec69f-72de-4c94-a569-c56b808656d1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.383688 Aug 30 16:02:40.403662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 225/452] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:40 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:02:40.414519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:02:40.414931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Tue Aug 30 16:02:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 (ip 10.222.0.20) !!! Aug 30 16:02:40.524410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:40.533237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ac7b0aea-2685-4492-9164-f681afcdf9bb tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1271 microversion: 2.1 time: 0.334559 Aug 30 16:02:40.534332 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 228/453] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:40 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1271 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:40.979635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-65efba63-721f-4d1e-bb8a-0ecf03ee452a req-5bc50dd4-246d-49c1-a915-7f3865261192 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:40.989971 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-65efba63-721f-4d1e-bb8a-0ecf03ee452a req-5bc50dd4-246d-49c1-a915-7f3865261192 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:40.990447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-65efba63-721f-4d1e-bb8a-0ecf03ee452a req-5bc50dd4-246d-49c1-a915-7f3865261192 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:40.990875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-65efba63-721f-4d1e-bb8a-0ecf03ee452a req-5bc50dd4-246d-49c1-a915-7f3865261192 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:41.002712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-65efba63-721f-4d1e-bb8a-0ecf03ee452a req-5bc50dd4-246d-49c1-a915-7f3865261192 service nova] Creating event network-changed:5194bcb5-34ff-4ad0-a9c9-88ff1f060707 for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 on hv-cinder-85505 Aug 30 16:02:41.007791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-65efba63-721f-4d1e-bb8a-0ecf03ee452a req-5bc50dd4-246d-49c1-a915-7f3865261192 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031921 Aug 30 16:02:41.008399 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 226/454] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:02:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:41.429625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:41.430430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:41.437107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:41.437895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:41.438467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:41.439334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:41.439919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:41.440482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:41.556000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:41.556919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:41.563585 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:41.564139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:41.564762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:41.565542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:41.566091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:41.566672 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:41.586115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:41.596157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:41.597857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:41.599353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0e259576-8540-4f6d-b573-9b926aa9b1b5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.175341 Aug 30 16:02:41.613454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 229/455] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:41 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:41.726389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:41.736825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e44b01e7-633a-4739-85dc-c92d17729ae1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.185706 Aug 30 16:02:41.737499 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 227/456] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:41 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:42.220363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-b9146c88-a7c5-43ec-923a-95833042a99b req-d6d5c0b2-40da-460c-9903-803a88c0293f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "name": "network-vif-plugged", "status": "completed", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:42.232845 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b9146c88-a7c5-43ec-923a-95833042a99b req-d6d5c0b2-40da-460c-9903-803a88c0293f service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.234799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b9146c88-a7c5-43ec-923a-95833042a99b req-d6d5c0b2-40da-460c-9903-803a88c0293f service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.235453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-b9146c88-a7c5-43ec-923a-95833042a99b req-d6d5c0b2-40da-460c-9903-803a88c0293f service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.247934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-b9146c88-a7c5-43ec-923a-95833042a99b req-d6d5c0b2-40da-460c-9903-803a88c0293f service nova] Creating event network-vif-plugged:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 16:02:42.253165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-b9146c88-a7c5-43ec-923a-95833042a99b req-d6d5c0b2-40da-460c-9903-803a88c0293f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038410 Aug 30 16:02:42.254052 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 230/457] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:02:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:42.615294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:42.616164 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:42.627222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.627983 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.628769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.629510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.629737 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:42.630159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.630345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.630452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:42.632413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=36 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:42.638030 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.638512 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.638937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.639658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.640073 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.640520 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.655099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-484578d4-c76a-40a6-a0f3-dfcb648bc657 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/ips" status: 200 len: 149 microversion: 2.1 time: 0.046733 Aug 30 16:02:42.655803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 228/458] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:02:42 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:42.667286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2a06f2d1-c8d4-45db-b957-c87d2f66abe7"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:42.669696 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:42.675722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.676222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.676648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.677369 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.677927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.678432 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.764261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Invalid volume: volume 2a06f2d1-c8d4-45db-b957-c87d2f66abe7 is already attached to instances: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: POST /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/os-volume_attachments HTTP/1.1 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 74 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:02:42.766021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {"volumeAttachment": {"volumeId": "2a06f2d1-c8d4-45db-b957-c87d2f66abe7"}} Aug 30 16:02:42.767647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Invalid volume: volume 2a06f2d1-c8d4-45db-b957-c87d2f66abe7 is already attached to instances: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'server_id': '096b49e4-be8b-48c6-88a3-19b6a555ff37', 'body': {'volumeAttachment': {'volumeId': '2a06f2d1-c8d4-45db-b957-c87d2f66abe7'}}} Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2a06f2d1-c8d4-45db-b957-c87d2f66abe7 is already attached to instances: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:02:42.768494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2a06f2d1-c8d4-45db-b957-c87d2f66abe7 is already attached to instances: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:02:42.769928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:02:42.771566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:02:42.771566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:02:42.771566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:02:42.771566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2a06f2d1-c8d4-45db-b957-c87d2f66abe7 is already attached to instances: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 Aug 30 16:02:42.771566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:02:42.773333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 400 to user: Invalid volume: volume 2a06f2d1-c8d4-45db-b957-c87d2f66abe7 is already attached to instances: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:02:42.774322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54c226d5-7575-4e00-ba37-494fe5a9e431 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.111400 Aug 30 16:02:42.780689 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 229/459] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:02:42 2022] POST /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:02:42.786497 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:42.786956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:42.795283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.795779 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.796211 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.796909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.797397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.797820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.801629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:42.812790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:42.821490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:42.822706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-62a42382-fc4d-485f-a2b0-534f75df473c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.200734 Aug 30 16:02:42.823392 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 231/460] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:42 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:42.828023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:42.830664 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:42.841644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.842146 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.842642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.843343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.844183 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.846051 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.875957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:02:42.967013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-017a9391-9e5b-4e7f-bd10-3b5d6ff23abd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 204 len: 0 microversion: 2.1 time: 0.142035 Aug 30 16:02:42.968549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 232/461] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:02:42 2022] DELETE /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:42.979148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:42.979957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:42.987018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.987584 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.988351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:42.989115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:42.989644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:42.990122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:43.045503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:43.057683 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-320b7c44-4b7b-4e5c-a537-a654ecfeef43 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.275757 Aug 30 16:02:43.058997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 230/462] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:42 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:43.163013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:43.171141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1e83a09b-2f8f-4446-8d32-bf97e9071164 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1681 microversion: 2.1 time: 0.197260 Aug 30 16:02:43.171690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 233/463] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:42 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1681 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:43.849938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:43.851171 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:43.862839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:43.863534 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:43.863995 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:43.864825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:43.865333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:43.865755 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:43.868440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:44.008955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:44.018380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:44.019881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:44.021068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f31824d8-3bd2-4328-9e90-927392375015 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.177799 Aug 30 16:02:44.021653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 231/464] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:43 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:44.079474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:44.080051 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:44.086859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:44.087356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:44.087802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:44.088464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:44.088910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:44.089374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:44.192085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:44.192691 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:44.198660 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:44.199142 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:44.199572 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:44.200261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:44.200711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:44.201165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:44.222628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:44.230375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-98358f3c-7403-4aef-860a-fa48160bd7a9 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.154876 Aug 30 16:02:44.230949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 234/465] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:44 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:44.333520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:44.343563 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-112d9538-61b1-4a58-ad4e-6705f69d6e57 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1681 microversion: 2.1 time: 0.155389 Aug 30 16:02:44.344434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 232/466] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:44 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:45.044362 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:45.045046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:45.051342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:45.051824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:45.052250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:45.052930 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:45.053410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:45.053830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:45.188365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:45.197963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:45.199556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:45.200717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ce2a9ac-6e15-4aeb-98a6-2c3d42d89b1d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.160520 Aug 30 16:02:45.201242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 235/467] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:45 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:45.251836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:45.252410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:45.261902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:45.262382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:45.262819 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:45.263505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:45.263953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:45.264375 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:45.366440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:45.367076 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:45.373545 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:45.374028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:45.374465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:45.375234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:45.375689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:45.376106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:45.402943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:45.411431 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5fbaf467-8ea5-4f65-be30-e04eed6ac28e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.163310 Aug 30 16:02:45.412098 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 233/468] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:45 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:45.519089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:45.531210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2b1277d8-6ff2-4eae-a28a-1df1cdbbc8a0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1681 microversion: 2.1 time: 0.168578 Aug 30 16:02:45.532141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 236/469] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:45 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:46.225105 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:46.225995 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:46.234331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:46.234999 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:46.235984 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:46.236930 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:46.237774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:46.238367 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:46.372681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:46.381634 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:46.383074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:46.384262 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5978d5a9-197b-4bd7-9b02-54c566a1cdfe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.164060 Aug 30 16:02:46.384861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 234/470] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:46 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:46.433112 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:46.433643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:46.440673 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:46.441153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:46.441743 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:46.442453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:46.442924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:46.443341 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:46.554037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:46.554768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:46.561115 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:46.561604 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:46.562036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:46.562763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:46.563182 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:46.563602 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:46.597320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:46.605479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fc524289-a147-4354-ab0c-09726755b50b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.176382 Aug 30 16:02:46.606063 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 237/471] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:46 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:46.687805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:46.691856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:46.700049 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c737ca3a-7cc3-4f7f-b62d-38e00779d86f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1681 microversion: 2.1 time: 0.149854 Aug 30 16:02:46.700615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 235/472] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:46 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:47.415424 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:47.416017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:47.418233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:47.425630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:47.426314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:47.426739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:47.427419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:47.427866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:47.428278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:47.567394 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:47.569630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:47.577862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:47.579272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:47.580473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4d1b99ec-b94a-44d5-a632-4a3589aa2b4e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.169115 Aug 30 16:02:47.581031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 238/473] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:47 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:47.626485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:47.627143 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:47.628998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:47.635314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:47.635801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:47.636234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:47.636928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:47.637408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:47.637847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:47.720845 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:47.721677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:47.728672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:47.729207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:47.729717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:47.730404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:47.731020 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:47.731453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:47.846139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:47.854564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-396ef564-9d1c-4281-af9d-00cad6c6ea95 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.231855 Aug 30 16:02:47.855143 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 236/474] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:47 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:47.917064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:47.928623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-18295d97-31d3-4b7f-80b4-9b03c50c5186 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1681 microversion: 2.1 time: 0.211322 Aug 30 16:02:47.929500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 239/475] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:47 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1681 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:48.604388 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:48.604997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:48.611377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:48.611866 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:48.612297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:48.612988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:48.613467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:48.613890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:48.848620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:48.858552 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:48.860078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:48.862966 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b93649be-0391-4367-ab81-86c709ef4428 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1808 microversion: 2.20 time: 0.262140 Aug 30 16:02:48.863710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 237/476] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:48 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1808 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:48.881843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:48.882458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:48.889755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:48.890268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:48.890722 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:48.892065 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:48.892523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:48.892944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:48.954525 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:48.955141 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:48.961351 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:48.961848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:48.962282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:48.962987 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:48.963456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:48.964110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:49.236177 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:49.245843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fea407c4-d56f-4254-82ea-d5badbb6ceb6 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.372987 Aug 30 16:02:49.246774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 240/477] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:48 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:49.280559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:49.289012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dcd4c924-fcf4-4d5a-a63a-4455a37ba8b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1681 microversion: 2.1 time: 0.338296 Aug 30 16:02:49.289867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 238/478] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:48 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1681 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:49.887233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:49.887947 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:49.894643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:49.895106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:49.895591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:49.896297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:49.896744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:49.897234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:49.989928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-e505e0e8-9a63-4808-a5fe-da002c5be7e2 req-62352511-b32b-49c3-9a8c-945769695b29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "096b49e4-be8b-48c6-88a3-19b6a555ff37", "name": "network-vif-deleted", "tag": "6b029260-3e6c-4a95-bbdd-4563d871c661"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:50.001610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e505e0e8-9a63-4808-a5fe-da002c5be7e2 req-62352511-b32b-49c3-9a8c-945769695b29 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:50.002462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e505e0e8-9a63-4808-a5fe-da002c5be7e2 req-62352511-b32b-49c3-9a8c-945769695b29 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:50.002949 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-e505e0e8-9a63-4808-a5fe-da002c5be7e2 req-62352511-b32b-49c3-9a8c-945769695b29 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:50.015567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-e505e0e8-9a63-4808-a5fe-da002c5be7e2 req-62352511-b32b-49c3-9a8c-945769695b29 service nova] Creating event network-vif-deleted:6b029260-3e6c-4a95-bbdd-4563d871c661 for instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 on hv-cinder-85505 Aug 30 16:02:50.021131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-e505e0e8-9a63-4808-a5fe-da002c5be7e2 req-62352511-b32b-49c3-9a8c-945769695b29 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035476 Aug 30 16:02:50.022028 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 239/479] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:02:50.075841 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:50.087439 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:50.089212 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:50.090625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb5db6bd-d0c5-4aaf-9b1b-55f1e6d60325 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1795 microversion: 2.20 time: 0.207453 Aug 30 16:02:50.092207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 241/480] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:02:49 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1795 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:02:50.270607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:50.271395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:50.278649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:50.279205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:50.280074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:50.280900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:50.281456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:50.282072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:50.312119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:50.312912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:50.332539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:50.334280 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:50.336002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:50.337489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:50.339147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:50.339589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:50.419104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:50.419972 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:50.420738 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:50.421428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid 096b49e4-be8b-48c6-88a3-19b6a555ff37 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:02:50.477173 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:50.488339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-284447f8-6de0-42e9-ad58-8b1a2da79ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 200 len: 1331 microversion: 2.1 time: 0.181318 Aug 30 16:02:50.488918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 242/481] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:50 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 1331 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:02:50.517756 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:50.526211 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63059ad1-1e6d-40cc-b6a6-30bcdc862f99 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.260362 Aug 30 16:02:50.529394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 240/482] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:50 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:51.512110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:51.512805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:51.519421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:51.519884 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:51.520302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:51.521175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:51.521778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:51.522486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:51.539128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 HTTP/1.1 Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:02:51.541196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:02:51.542810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '096b49e4-be8b-48c6-88a3-19b6a555ff37'} Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:02:51.543759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:02:51.545115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:02:51.547335 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:02:51.548267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:51.549016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:51.549505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c35cd99b-c0c0-4325-be8c-842ac900ae56 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 404 len: 111 microversion: 2.1 time: 0.041265 Aug 30 16:02:51.550496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 243/483] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:51 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:02:51.556530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:51.557019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:51.557500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:51.558331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:51.558802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:51.565246 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:51.565395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-129ecf03-97a5-45b6-ab13-cf220a475057 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '.version_select at 0x7f48480a9820>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:51.589922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-129ecf03-97a5-45b6-ab13-cf220a475057 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171908399" status: 202 len: 0 microversion: 2.1 time: 0.034989 Aug 30 16:02:51.590927 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 244/484] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 30 16:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1171908399 => generated 0 bytes in 36 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:02:51.710587 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:51.718235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00efc9e4-a11f-4b31-bed8-65f348a8871a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.174096 Aug 30 16:02:51.718801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 241/485] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:51 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:52.299355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3eb94034-ea01-4807-8599-cf14e6e4fa07 req-e8e4fd03-04d8-4900-b929-9c14331d03da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "name": "network-vif-plugged", "status": "completed", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:52.313546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3eb94034-ea01-4807-8599-cf14e6e4fa07 req-e8e4fd03-04d8-4900-b929-9c14331d03da service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.314247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3eb94034-ea01-4807-8599-cf14e6e4fa07 req-e8e4fd03-04d8-4900-b929-9c14331d03da service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.314921 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3eb94034-ea01-4807-8599-cf14e6e4fa07 req-e8e4fd03-04d8-4900-b929-9c14331d03da service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.329683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3eb94034-ea01-4807-8599-cf14e6e4fa07 req-e8e4fd03-04d8-4900-b929-9c14331d03da service nova] Creating event network-vif-plugged:5194bcb5-34ff-4ad0-a9c9-88ff1f060707 for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 on hv-cinder-85505 Aug 30 16:02:52.335905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3eb94034-ea01-4807-8599-cf14e6e4fa07 req-e8e4fd03-04d8-4900-b929-9c14331d03da service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042541 Aug 30 16:02:52.336757 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 245/486] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:02:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:02:52.657779 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:52.658374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:52.664894 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.665404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.665830 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.666520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.666952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.667388 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.741306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:52.742871 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:52.751724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.752842 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.753481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.754558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.755539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.756109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.816499 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'services' on Instance uuid 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:02:52.924523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:52.932573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1c0465ea-3f21-4530-b7a5-b6d8876c4e05 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.196872 Aug 30 16:02:52.933139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 246/487] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:52 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:52.936250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c87492f3-6388-496b-9c53-498fc6d16e8b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments/2a06f2d1-c8d4-45db-b957-c87d2f66abe7" status: 202 len: 0 microversion: 2.1 time: 0.282518 Aug 30 16:02:52.936917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 242/488] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:02:52 2022] DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments/2a06f2d1-c8d4-45db-b957-c87d2f66abe7 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:02:52.945504 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:52.948012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:52.954932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.955422 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.955841 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.956537 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.957147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:52.957597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:52.986548 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "af70bde1-6af7-4f96-a222-984f2ff125c2"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:52.989094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cebc6939-92bb-4877-8315-6abf88b59bf6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047764 Aug 30 16:02:52.989292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:52.989821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 247/489] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:02:52 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:52.999422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:52.999910 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:53.000355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:53.001055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:53.001559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:53.001982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:53.886173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8eebf08d-2cf8-4572-962f-cc034113c68a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.904479 Aug 30 16:02:53.886856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 243/490] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:02:52 2022] POST /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments => generated 194 bytes in 906 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:53.953662 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:53.954240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:53.961359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:53.961827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:53.962243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:53.962920 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:53.963355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:53.963750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:54.002427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:54.010032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:54.016341 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:54.016818 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:54.017245 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:54.017956 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:54.018404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:54.018813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:54.051612 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6caf02d1-5bd4-45a3-a476-428f851968cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054262 Aug 30 16:02:54.053259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 244/491] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:02:53 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:54.109252 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:54.118558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e955c4fa-8b54-41ab-8fe6-b34a8e45d17b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1259 microversion: 2.1 time: 0.168803 Aug 30 16:02:54.119145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 248/492] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:53 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:55.064291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:55.066273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:55.073053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:55.073628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:55.074062 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:55.074762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:55.075211 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:55.075633 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:55.120841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92f7a926-17cb-4de9-b767-b49ac049ef89 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060601 Aug 30 16:02:55.121703 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 245/493] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:02:55 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:55.139076 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:55.139857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:55.146440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:55.147016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:55.147509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:55.148396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:55.149017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:55.149528 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:55.289758 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:55.298573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fbd83289-3b6a-4693-902d-372e597f5ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1443 microversion: 2.1 time: 0.163314 Aug 30 16:02:55.299205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 249/494] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:55 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:55.319601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:55.320238 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:55.326886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:55.327365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:55.327792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:55.328476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:55.328928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:55.329371 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:55.346780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:02:55.470532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:55.479037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8a8249c2-7b5a-4664-bcc4-b537e3ff349d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1443 microversion: 2.1 time: 0.163373 Aug 30 16:02:55.479622 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 246/495] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:55 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1443 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:56.136109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:56.139478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:56.148230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:56.148926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:56.149534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:56.150582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:56.151562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:56.152256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:56.205628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d750a028-3d10-40f2-9718-2e0bb93b3e55 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.076025 Aug 30 16:02:56.206352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 250/496] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:02:56 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0/os-volume_attachments => generated 25 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:02:56.272609 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:56.273154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:56.279460 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:56.279945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:56.280376 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:56.281063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:56.281542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:56.281961 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:56.310726 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:02:56.400058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7f06d06-2e1a-456b-9641-311df37b0ebf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 204 len: 0 microversion: 2.1 time: 0.131059 Aug 30 16:02:56.400674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 247/497] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:02:56 2022] DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:02:56.409111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:56.409747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:56.415873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:56.416350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:56.416808 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:56.417532 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:56.417982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:56.418397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:56.552386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:56.561739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-03388f07-0922-4fb2-a431-9f77186458b7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1683 microversion: 2.1 time: 0.156406 Aug 30 16:02:56.565259 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 251/498] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:56 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1683 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:57.297017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-918e5ae9-7138-45ac-809a-e25c819e205a req-1bc392f8-c69a-4299-b689-ae2b0fc413b4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:57.308031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-918e5ae9-7138-45ac-809a-e25c819e205a req-1bc392f8-c69a-4299-b689-ae2b0fc413b4 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:57.308506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-918e5ae9-7138-45ac-809a-e25c819e205a req-1bc392f8-c69a-4299-b689-ae2b0fc413b4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:57.308923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-918e5ae9-7138-45ac-809a-e25c819e205a req-1bc392f8-c69a-4299-b689-ae2b0fc413b4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:57.324278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-918e5ae9-7138-45ac-809a-e25c819e205a req-1bc392f8-c69a-4299-b689-ae2b0fc413b4 service nova] Creating event network-changed:5194bcb5-34ff-4ad0-a9c9-88ff1f060707 for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 on hv-cinder-85505 Aug 30 16:02:57.329500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-918e5ae9-7138-45ac-809a-e25c819e205a req-1bc392f8-c69a-4299-b689-ae2b0fc413b4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036792 Aug 30 16:02:57.330109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 248/499] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:02:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:57.586345 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:57.587152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:57.596237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:57.596825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:57.597588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:57.599012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:57.599742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:57.600341 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:57.740288 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:57.748426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5c77d3ef-ea23-47a1-a653-2f3e8c6a3ed9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1683 microversion: 2.1 time: 0.168672 Aug 30 16:02:57.749111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 252/500] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:57 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1683 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:58.771148 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:58.771983 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:58.779330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:58.779815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:58.780241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:58.780937 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:58.781428 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:58.781898 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:58.921468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:02:58.929242 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-23fb4c3b-78a5-46e7-bd22-36a3146946e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1683 microversion: 2.1 time: 0.162318 Aug 30 16:02:58.929930 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 249/501] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:58 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1683 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:02:59.471741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c51aafad-d077-4506-af17-4fda3c7e9ddc req-c19ef6db-3339-4718-88c8-2ea2d3568c71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d200922-337c-4f7b-afc6-6a2c2b2dc9b0", "name": "network-vif-deleted", "tag": "29d214d9-d6a5-4d66-972d-16d87ca7639c"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:02:59.484112 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c51aafad-d077-4506-af17-4fda3c7e9ddc req-c19ef6db-3339-4718-88c8-2ea2d3568c71 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:59.485138 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c51aafad-d077-4506-af17-4fda3c7e9ddc req-c19ef6db-3339-4718-88c8-2ea2d3568c71 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:59.486081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c51aafad-d077-4506-af17-4fda3c7e9ddc req-c19ef6db-3339-4718-88c8-2ea2d3568c71 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:59.498323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c51aafad-d077-4506-af17-4fda3c7e9ddc req-c19ef6db-3339-4718-88c8-2ea2d3568c71 service nova] Creating event network-vif-deleted:29d214d9-d6a5-4d66-972d-16d87ca7639c for instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 on hv-cinder-85505 Aug 30 16:02:59.504011 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c51aafad-d077-4506-af17-4fda3c7e9ddc req-c19ef6db-3339-4718-88c8-2ea2d3568c71 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036023 Aug 30 16:02:59.504813 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 253/502] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:02:59.951844 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:02:59.952481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:02:59.959872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:59.960289 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:59.960721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:59.961451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:59.961903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:59.962324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:59.997030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:02:59.997540 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:02:59.998222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:02:59.998675 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:03:00.039268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:00.048995 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a382a15a-48f2-487c-9e52-4e2d854daafb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 200 len: 1332 microversion: 2.1 time: 0.101041 Aug 30 16:03:00.049665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 250/503] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:02:59 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:01.075320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:01.076077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:01.085886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:01.086360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:01.086784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:01.087461 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:01.087902 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:01.088310 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:01.101878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 HTTP/1.1 Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:03:01.103923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:03:01.106747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '9d200922-337c-4f7b-afc6-6a2c2b2dc9b0'} Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:01.108406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:03:01.111539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:03:01.113892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:01.113892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9b9b246d-83c2-4cc6-a34e-7e8b977f5a5c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 404 len: 111 microversion: 2.1 time: 0.037699 Aug 30 16:03:01.113892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 254/504] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:01 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:03:01.116261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d6b99fe4-bae3-4955-87dd-2c32ea66ff20 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '.version_select at 0x7f4843f180d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:01.140056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d6b99fe4-bae3-4955-87dd-2c32ea66ff20 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262126823" status: 202 len: 0 microversion: 2.1 time: 0.027712 Aug 30 16:03:01.140803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 251/505] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 30 16:03:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1262126823 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:01.796528 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-73729f1c-96dc-41d6-a200-189fd4df87b6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: .version_select at 0x7f48481363a0>, body: {"keypair": {"name": "tempest-keypair-960906845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLG/Pmx9CM/WHYxRZ4BEIdi7Fr196HPQf+21EJXnVzppooi6S0PU5RAvHzxtrRohdVrpYqq+ZA9ifaDbiba1mtdl9dEj/H4NlxCXCja8sxJcdERr3zAzPv8vn8gUSepMwQ=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:01.813100 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-73729f1c-96dc-41d6-a200-189fd4df87b6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:03:01.818205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-73729f1c-96dc-41d6-a200-189fd4df87b6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:03:01.850089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-73729f1c-96dc-41d6-a200-189fd4df87b6 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.058508 Aug 30 16:03:01.851236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 255/506] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:03:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:02.507955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:02.510215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:02.517093 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:02.517662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:02.518097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:02.518795 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:02.519412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:02.519998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:02.543351 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lazy-loading 'flavor' on Instance uuid 6b410390-11de-461d-ae41-a8f036f5d694 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:03:02.674934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3fe43621-e734-4792-8369-b7a9a3382675 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/action" status: 200 len: 32 microversion: 2.1 time: 0.171950 Aug 30 16:03:02.675585 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 252/507] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:03:02 2022] POST /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/action => generated 32 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 30 16:03:02.685706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:02.686320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:02.697573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:02.698361 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:02.698910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:02.699708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:02.700234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:02.700689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:02.896356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:02.905344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8bc36065-16e2-4014-8c93-1a4a84b5850d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.223487 Aug 30 16:03:02.905922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 256/508] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:02 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:03.281182 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-586016135", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3aa7438-61b4-41af-81a0-39b48f126de4"}], "security_groups": [{"name": "tempest-securitygroup--99048889"}], "key_name": "tempest-keypair-960906845", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:03.382674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] validate_networks() for [('b3aa7438-61b4-41af-81a0-39b48f126de4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:03:03.766824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:03:03.767483 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:03:03.767704 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:03:03.768106 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:03:03.768509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:03:03.778024 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:03.778500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:03.778927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:03.779674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:03.780147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:03.780546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:03.797900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:03:03.801935 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:03:03.814255 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:03:03.816639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:03:03.841006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=5,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:03.867926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0b01dfe-46df-41a2-8af6-daa0875dd0be tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.591524 Aug 30 16:03:03.868569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 253/509] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:03:03 2022] POST /compute/v2.1/servers => generated 400 bytes in 593 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:03:03.879737 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bc8c0106-a0c8-4ce4-a094-62d4eb6e06f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:03.880366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bc8c0106-a0c8-4ce4-a094-62d4eb6e06f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:03.927406 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:03.928012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:03.936033 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:03.936236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc8c0106-a0c8-4ce4-a094-62d4eb6e06f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:03.936958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:03.937537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:03.938309 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:03.938764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:03.939188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:03.943723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bc8c0106-a0c8-4ce4-a094-62d4eb6e06f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1240 microversion: 2.1 time: 0.068030 Aug 30 16:03:03.944497 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 257/510] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:03 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:04.077000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:04.086226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2abcc881-44cb-4700-b645-83c2c3380a7e tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.163066 Aug 30 16:03:04.086972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 254/511] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:03 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:04.968949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:04.969996 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:04.978890 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:04.979365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:04.979785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:04.980463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:04.980901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:04.981341 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:05.049811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:05.057623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0b0f794f-2a13-4181-89a6-f8aeabd80ab1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1292 microversion: 2.1 time: 0.095417 Aug 30 16:03:05.058177 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 258/512] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:04 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1292 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:05.111994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:05.112985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:05.122380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:05.123078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:05.123692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:05.124685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:05.125364 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:05.125972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:05.265775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:05.285316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-45c437fb-3218-41f7-88fe-5f9c570201be tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.180256 Aug 30 16:03:05.286125 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 255/513] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:05 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:06.078180 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:06.078824 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:06.085363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:06.085926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:06.086371 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:06.087067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:06.087531 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:06.087946 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:06.239736 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:06.248279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bf580577-fd9a-4915-a880-d9eb08780df7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.173933 Aug 30 16:03:06.249007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 259/514] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:06 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:06.306776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:06.307377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:06.313948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:06.314422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:06.314845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:06.315526 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:06.315966 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:06.316378 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:06.452390 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:06.460817 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-db87f810-626a-41ce-a61b-88abd777f90a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.157933 Aug 30 16:03:06.461491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 256/515] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:06 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:06.789918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-bfc20e1c-9343-4e59-a9b2-ef5494e6ca88 req-d22c5558-e900-459e-98b4-a77b6710c990 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbff92f4-6c46-464b-93ac-6d56f92d2395", "tag": "926d2182-901e-47cb-a1ce-48a18173cf88"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:06.800107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bfc20e1c-9343-4e59-a9b2-ef5494e6ca88 req-d22c5558-e900-459e-98b4-a77b6710c990 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:06.800621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bfc20e1c-9343-4e59-a9b2-ef5494e6ca88 req-d22c5558-e900-459e-98b4-a77b6710c990 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:06.801089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bfc20e1c-9343-4e59-a9b2-ef5494e6ca88 req-d22c5558-e900-459e-98b4-a77b6710c990 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:06.812660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-bfc20e1c-9343-4e59-a9b2-ef5494e6ca88 req-d22c5558-e900-459e-98b4-a77b6710c990 service nova] Creating event network-changed:926d2182-901e-47cb-a1ce-48a18173cf88 for instance dbff92f4-6c46-464b-93ac-6d56f92d2395 on hv-cinder-85505 Aug 30 16:03:06.817466 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-bfc20e1c-9343-4e59-a9b2-ef5494e6ca88 req-d22c5558-e900-459e-98b4-a77b6710c990 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031347 Aug 30 16:03:06.818061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 260/516] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:07.269805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:07.270442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:07.276825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:07.277345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:07.277783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:07.278477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:07.278922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:07.279340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:07.416851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:07.424827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e3d446a7-77e3-4415-a60e-5444a7b9bbd8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.159019 Aug 30 16:03:07.425430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 257/517] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:07 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:07.483398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:07.484079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:07.491309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:07.491786 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:07.492217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:07.492919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:07.493391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:07.493811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:07.508720 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:07.633807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:07.642525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fc5a40e9-582e-4a19-9937-9ea162981996 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.163915 Aug 30 16:03:07.643096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 261/518] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:07 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:08.445596 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:08.446151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:08.452836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:08.453343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:08.453801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:08.454539 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:08.454976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:08.455391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:08.582494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:08.590539 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a64dd465-94b5-4841-b3ba-2edf649de266 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.149024 Aug 30 16:03:08.591128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 258/519] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:08 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:08.664240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:08.664795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:08.671983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:08.672459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:08.672912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:08.673638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:08.674092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:08.674516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:08.806844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:08.815145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-48795be9-c732-45e6-bf1f-7e0e0c1c6c16 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.154865 Aug 30 16:03:08.816006 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 262/520] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:08 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:09.611724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:09.612325 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:09.618901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:09.619387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:09.619816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:09.620543 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:09.621029 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:09.621484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:09.758717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:09.769906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5e29ab5a-9b70-420a-bc53-9e0364e080f8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.162285 Aug 30 16:03:09.770658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 259/521] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:09 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:09.838912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:09.840017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:09.846606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:09.847109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:09.847534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:09.848201 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:09.848655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:09.849071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:09.997567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:10.005935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6b9117d8-571b-42c8-9772-cff39d88018a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.173385 Aug 30 16:03:10.006547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 263/522] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:09 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:10.793201 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:10.794059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:10.801368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:10.802116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:10.802528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:10.803193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:10.803828 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:10.804240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:10.946181 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:10.954052 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6bd70523-2384-4ab2-8432-65b4987d1488 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.164898 Aug 30 16:03:10.954673 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 260/523] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:10 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:11.027323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:11.027892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:11.034690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:11.035177 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:11.035612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:11.036300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:11.036766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:11.037312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:11.175726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:11.187523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-03b780ec-ff10-4b02-8f9d-f1852ec60507 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.164145 Aug 30 16:03:11.188123 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 264/524] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:11 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:11.978913 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:11.979744 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:11.991165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:11.991948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:11.992897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:11.994139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:11.994898 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:11.995606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:12.014380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:12.145873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:12.155087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-379ce675-4b4f-4bf0-8f8a-20692bc11a7d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.182937 Aug 30 16:03:12.155731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 261/525] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:11 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:12.215853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:12.216508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:12.224036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:12.224816 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:12.225049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:12.225819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:12.226275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:12.226696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:12.336560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f6762f28-0fea-47f2-bedc-548a3f34f26c req-e258c918-52eb-46e0-b486-6ac29d4c217b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbff92f4-6c46-464b-93ac-6d56f92d2395", "name": "network-vif-plugged", "status": "completed", "tag": "926d2182-901e-47cb-a1ce-48a18173cf88"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:12.346470 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f6762f28-0fea-47f2-bedc-548a3f34f26c req-e258c918-52eb-46e0-b486-6ac29d4c217b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:12.347031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f6762f28-0fea-47f2-bedc-548a3f34f26c req-e258c918-52eb-46e0-b486-6ac29d4c217b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:12.347554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f6762f28-0fea-47f2-bedc-548a3f34f26c req-e258c918-52eb-46e0-b486-6ac29d4c217b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:12.359258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f6762f28-0fea-47f2-bedc-548a3f34f26c req-e258c918-52eb-46e0-b486-6ac29d4c217b service nova] Creating event network-vif-plugged:926d2182-901e-47cb-a1ce-48a18173cf88 for instance dbff92f4-6c46-464b-93ac-6d56f92d2395 on hv-cinder-85505 Aug 30 16:03:12.360985 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:12.364746 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f6762f28-0fea-47f2-bedc-548a3f34f26c req-e258c918-52eb-46e0-b486-6ac29d4c217b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032040 Aug 30 16:03:12.365620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 262/526] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:03:12.370308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4e143bd8-d369-4997-8b79-9803b70ae8cb tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.158591 Aug 30 16:03:12.370932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 265/527] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:12 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:13.177429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:13.179057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:13.185640 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:13.186204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:13.186717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:13.187466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:13.187921 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:13.188396 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:13.358866 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:13.367355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b7721808-8d46-4b4a-87e2-3fc02ee3c0e5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.195112 Aug 30 16:03:13.367909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 263/528] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:13 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:03:13.391896 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:13.392538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:13.395237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=89,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:13.401129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:13.401647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:13.402075 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:13.402768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:13.403217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:13.403632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:13.554523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:13.563165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6a5c79b3-714f-4a1c-a5cc-2b5d576d66c6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.175197 Aug 30 16:03:13.563768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 266/529] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:13 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:14.390512 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:14.391159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:14.393470 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:14.394188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:14.400965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:14.401509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:14.401960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:14.402685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:14.403151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:14.403592 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:14.539197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:14.548242 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fdbd360-42be-482d-9801-e22c1eeb4caf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1364 microversion: 2.1 time: 0.162981 Aug 30 16:03:14.548820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 264/530] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:14 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:14.586229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:14.586835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:14.588696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:14.595025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:14.595511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:14.596027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:14.596719 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:14.597169 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:14.597617 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:14.728326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:14.741532 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-53e427e0-afcd-4624-8d4b-469ca7d2121a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.158759 Aug 30 16:03:14.742283 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 267/531] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:14 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:15.573718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:15.574710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:15.583521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:15.584006 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:15.584439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:15.585131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:15.585622 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:15.586046 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:15.719592 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:15.727800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c03e340-9a71-4598-85f3-36e3af8e0dbb tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1554 microversion: 2.1 time: 0.160651 Aug 30 16:03:15.728375 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 265/532] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:15 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:15.750906 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:15.751533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:15.760843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:15.761364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:15.761798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:15.762492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:15.762933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:15.763347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:15.765915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:15.766694 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:15.776952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:15.777484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:15.778425 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:15.778583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:15.779026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:15.779446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:15.871838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f089df0c-9ff2-4bb3-aaa8-1012c8e07f40 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.124835 Aug 30 16:03:15.872647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 268/533] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:03:15 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-interface => generated 284 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:15.939535 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:15.947864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1722840f-54e5-47ba-9f80-245eb033efa9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.186152 Aug 30 16:03:15.948465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 266/534] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:15 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:16.824620 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-83105cdb-4560-4daa-a473-43901a7352b4 req-ec260c22-2ac3-4387-b400-e10cceea32bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbff92f4-6c46-464b-93ac-6d56f92d2395", "tag": "926d2182-901e-47cb-a1ce-48a18173cf88"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:16.834663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-83105cdb-4560-4daa-a473-43901a7352b4 req-ec260c22-2ac3-4387-b400-e10cceea32bb service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:16.835128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-83105cdb-4560-4daa-a473-43901a7352b4 req-ec260c22-2ac3-4387-b400-e10cceea32bb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:16.835542 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-83105cdb-4560-4daa-a473-43901a7352b4 req-ec260c22-2ac3-4387-b400-e10cceea32bb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:16.848013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-83105cdb-4560-4daa-a473-43901a7352b4 req-ec260c22-2ac3-4387-b400-e10cceea32bb service nova] Creating event network-changed:926d2182-901e-47cb-a1ce-48a18173cf88 for instance dbff92f4-6c46-464b-93ac-6d56f92d2395 on hv-cinder-85505 Aug 30 16:03:16.853264 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-83105cdb-4560-4daa-a473-43901a7352b4 req-ec260c22-2ac3-4387-b400-e10cceea32bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032868 Aug 30 16:03:16.853879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 269/535] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:16.969902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:16.970544 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:16.977081 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:16.977600 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:16.978026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:16.978729 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:16.979174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:16.979583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:17.113925 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:17.122867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-69b27af9-2eff-444f-a50e-13cd53a5bbc7 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.157255 Aug 30 16:03:17.123658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 267/536] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:16 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:18.145286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:18.145997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:18.152733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:18.153206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:18.153665 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:18.154354 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:18.154795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:18.155201 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:18.290072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:18.299160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-03f6da2e-10fc-4a95-9583-5f0b245ff17a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.158626 Aug 30 16:03:18.299743 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 270/537] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:18 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:19.324845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:19.325800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:19.333985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:19.334461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:19.334887 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:19.335559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:19.336001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:19.336415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:19.488512 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:19.496934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80ee2f91-ac47-4330-8188-9ffa013b7dc0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.178915 Aug 30 16:03:19.497544 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 268/538] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:19 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:20.521473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:20.522369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:20.532124 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:20.532844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:20.533540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:20.534653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:20.535096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:20.535556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:20.677879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:20.686675 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b3b4d8c2-65d3-4ba4-93c8-ca3b5a7944f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.171382 Aug 30 16:03:20.687169 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 271/539] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:20 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:21.708318 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:21.708927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:21.716883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:21.717408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:21.718013 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:21.718718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:21.719175 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:21.719594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:21.861415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:21.871002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7eb526ba-f255-4173-827d-53c9a1246906 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1736 microversion: 2.1 time: 0.166806 Aug 30 16:03:21.871570 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 269/540] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:21 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:22.896222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:22.897248 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:22.908550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:22.909264 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:22.909950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:22.910817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:22.911258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:22.911675 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.049628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:23.058385 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a3141c6c-689c-4ac3-9fe2-940ab6eeff5f tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1716 microversion: 2.1 time: 0.169525 Aug 30 16:03:23.058932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 272/541] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:22 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1716 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:23.187400 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:23.187897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:23.194623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:23.195104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:23.195530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.196210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:23.196651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:23.197064 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.277249 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] HTTP exception thrown: Cannot 'detach_volume' instance 6b410390-11de-461d-ae41-a8f036f5d694 while it is in vm_state rescued Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Request method failure captured: Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments/af70bde1-6af7-4f96-a222-984f2ff125c2 HTTP/1.1 Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPbErh-lB5Rzlrt__YAi7syzEIzJE3yxDpiA5zbNCOrdVke1rtd2l_gAtR9dNM50llV3cAqlovCsNO5_om48W_hTZXnsSe27UOQdEFxyENhLjzUjAxkuy0_M3r2mOeT3E7C3kvowrhlBvNMeP2gsFJCVoMgg47z2rk4Y9zVIzJl77g Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:03:23.278864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: c34836a75f144f74aa3fd6a38ccb9791 Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:03:23.280305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Cannot 'detach_volume' instance 6b410390-11de-461d-ae41-a8f036f5d694 while it is in vm_state rescued Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'server_id': '6b410390-11de-461d-ae41-a8f036f5d694', 'id': 'af70bde1-6af7-4f96-a222-984f2ff125c2'} Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 6b410390-11de-461d-ae41-a8f036f5d694 in vm_state rescued. Cannot detach_volume while the instance is in this state. Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:23.281001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 6b410390-11de-461d-ae41-a8f036f5d694 while it is in vm_state rescued Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 6b410390-11de-461d-ae41-a8f036f5d694 while it is in vm_state rescued Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:23.282287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Returning 409 to user: Cannot 'detach_volume' instance 6b410390-11de-461d-ae41-a8f036f5d694 while it is in vm_state rescued {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:23.283237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9399c885-5404-4fb3-b7b5-e690f7f01855 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments/af70bde1-6af7-4f96-a222-984f2ff125c2" status: 409 len: 152 microversion: 2.1 time: 0.096850 Aug 30 16:03:23.283237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 270/542] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:03:23 2022] DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments/af70bde1-6af7-4f96-a222-984f2ff125c2 => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 30 16:03:23.289519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:23.290067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:23.296301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:23.296780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:23.297208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.297922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:23.298368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:23.298784 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.370190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6bd9e36c-b1d7-4bad-bad6-8cfb45c54120 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "POST /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/action" status: 202 len: 0 microversion: 2.1 time: 0.084502 Aug 30 16:03:23.370807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 273/543] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:03:23 2022] POST /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/action => generated 0 bytes in 86 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:03:23.379008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:23.379605 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:23.385882 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:23.386358 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:23.386785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.387623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:23.388087 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:23.388487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:23.518546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:23.527277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99e49163-7a62-44ac-875c-8d47204e7a57 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1724 microversion: 2.1 time: 0.152067 Aug 30 16:03:23.527876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 271/544] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:23 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:24.553759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:24.554678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:24.562808 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:24.563403 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:24.563941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:24.564791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:24.565389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:24.565905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:24.702711 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:24.711487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-faf7bc34-0c33-4722-86e9-641314807ed9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1724 microversion: 2.1 time: 0.164883 Aug 30 16:03:24.712047 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 274/545] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:24 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:25.739186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:25.740176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:25.750942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:25.751740 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:25.752462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:25.753633 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:25.754080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:25.754499 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:25.904263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:25.912716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-91850541-0312-4e64-8664-7aa4ae1b5179 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1724 microversion: 2.1 time: 0.180784 Aug 30 16:03:25.913281 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 272/546] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:25 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:26.938565 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:26.939459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:26.950561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:26.951357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:26.952069 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:26.953258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:26.954003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:26.954706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:27.104597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:27.114042 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-275947e7-ca9e-4b46-a032-b06a5a2f9645 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1730 microversion: 2.1 time: 0.182342 Aug 30 16:03:27.114627 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 275/547] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:03:26 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:27.145410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:27.145942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:27.152903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:27.153421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:27.153849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:27.154541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:27.154988 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:27.155405 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:27.235835 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3d2120b-ea80-41eb-8dba-d1eaac885353 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095443 Aug 30 16:03:27.236658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 273/548] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:03:27 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:28.372204 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-2464cf10-7d55-44ff-a087-884b11167cf2 req-558ad471-ef95-44fd-9983-ae5a7f2ea3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b410390-11de-461d-ae41-a8f036f5d694", "tag": "7fb957c8-4f9b-4421-b9ac-197b68f7a10e"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:28.382714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2464cf10-7d55-44ff-a087-884b11167cf2 req-558ad471-ef95-44fd-9983-ae5a7f2ea3a4 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:28.383335 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2464cf10-7d55-44ff-a087-884b11167cf2 req-558ad471-ef95-44fd-9983-ae5a7f2ea3a4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:28.383828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2464cf10-7d55-44ff-a087-884b11167cf2 req-558ad471-ef95-44fd-9983-ae5a7f2ea3a4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:28.397315 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-2464cf10-7d55-44ff-a087-884b11167cf2 req-558ad471-ef95-44fd-9983-ae5a7f2ea3a4 service nova] Creating event network-changed:7fb957c8-4f9b-4421-b9ac-197b68f7a10e for instance 6b410390-11de-461d-ae41-a8f036f5d694 on hv-cinder-85505 Aug 30 16:03:28.403244 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-2464cf10-7d55-44ff-a087-884b11167cf2 req-558ad471-ef95-44fd-9983-ae5a7f2ea3a4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034697 Aug 30 16:03:28.403995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 276/549] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:30.418233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-03ea12f9-6fb6-4d66-b8d6-d947ecd0758e req-6e060429-6159-4d19-9b3f-a131beda17ca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6b410390-11de-461d-ae41-a8f036f5d694", "tag": "7fb957c8-4f9b-4421-b9ac-197b68f7a10e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:30.428497 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03ea12f9-6fb6-4d66-b8d6-d947ecd0758e req-6e060429-6159-4d19-9b3f-a131beda17ca service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:30.428971 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03ea12f9-6fb6-4d66-b8d6-d947ecd0758e req-6e060429-6159-4d19-9b3f-a131beda17ca service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:30.429471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-03ea12f9-6fb6-4d66-b8d6-d947ecd0758e req-6e060429-6159-4d19-9b3f-a131beda17ca service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:30.441179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-03ea12f9-6fb6-4d66-b8d6-d947ecd0758e req-6e060429-6159-4d19-9b3f-a131beda17ca service nova] Creating event network-changed:7fb957c8-4f9b-4421-b9ac-197b68f7a10e for instance 6b410390-11de-461d-ae41-a8f036f5d694 on hv-cinder-85505 Aug 30 16:03:30.446370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-03ea12f9-6fb6-4d66-b8d6-d947ecd0758e req-6e060429-6159-4d19-9b3f-a131beda17ca service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032396 Aug 30 16:03:30.446952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 274/550] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:31.850737 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:31.851338 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:31.858335 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:31.858818 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:31.859249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:31.860281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:31.860729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:31.861151 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:31.901206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e2d867ed-d62c-4198-8bb9-1ea7ecf4ea75 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments/4e816ad9-9d9a-4535-b608-c898fc1fb096" status: 200 len: 194 microversion: 2.20 time: 0.056887 Aug 30 16:03:31.901873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 277/551] 10.222.0.20 () {60 vars in 1454 bytes} [Tue Aug 30 16:03:31 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments/4e816ad9-9d9a-4535-b608-c898fc1fb096 => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 30 16:03:31.975299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:31.975909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:31.982529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:31.983011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:31.983443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:31.984131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:31.984869 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:31.985360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:32.069824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lazy-loading 'services' on Instance uuid 54113782-135e-4dda-a0e9-600a7fa1ec9b {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:03:32.150801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-398adc35-293a-4678-b34e-2ca715e77f48 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments/4e816ad9-9d9a-4535-b608-c898fc1fb096" status: 202 len: 0 microversion: 2.20 time: 0.180142 Aug 30 16:03:32.151564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 275/552] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Aug 30 16:03:31 2022] DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments/4e816ad9-9d9a-4535-b608-c898fc1fb096 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:03:32.160944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:32.163378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:32.170502 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:32.171106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:32.172131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:32.173036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:32.173548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:32.173974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:32.201939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:32.206747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-567a56eb-e93e-4fc3-a703-d914f83b7392 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050166 Aug 30 16:03:32.207333 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 278/553] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 30 16:03:32 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:03:33.222015 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:33.224654 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:33.231241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:33.231701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:33.232135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:33.232826 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:33.233268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:33.233686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:33.264612 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e4a1400a-346a-41fb-b588-dde306c57eff tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048138 Aug 30 16:03:33.265163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 276/554] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 30 16:03:33 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:03:34.281367 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:34.284780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:34.296644 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:34.297461 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:34.298160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:34.299269 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:34.300211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:34.300853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:34.334467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bfac5440-0a58-4485-8329-7f996222bcf8 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.060417 Aug 30 16:03:34.335057 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 279/555] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 30 16:03:34 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:03:34.407752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:34.408282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:34.410745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:INSERT=1,nova_api:SELECT=47 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.416183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:34.416669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:34.417100 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:34.417826 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:34.418300 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:34.418718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:34.444277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:03:34.489840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:34.536485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7949231a-e9c6-4ff6-831d-f38710c52c78 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 204 len: 0 microversion: 2.20 time: 0.132432 Aug 30 16:03:34.537306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 277/556] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 30 16:03:34 2022] DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:03:34.545648 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:34.546239 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:34.552309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:34.552777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:34.553194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:34.553891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:34.554326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:34.554731 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:34.692810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:34.701258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:34.702701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:34.703860 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5db0c33e-dc56-4cd9-bca3-1cb755c68c00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.162236 Aug 30 16:03:34.704420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 280/557] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:34 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:35.731928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:35.733123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:35.743635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:35.744122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:35.744557 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:35.745263 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:35.745732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:35.746151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:35.888028 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:35.899342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:35.900828 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:35.901941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-da382a01-2236-4367-a87d-4701c581e085 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.177340 Aug 30 16:03:35.902715 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 278/558] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:35 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:36.924190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:36.924796 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:36.931730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:36.932205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:36.932637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:36.933370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:36.933817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:36.934242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:37.064924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:37.075050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:37.076489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:37.077711 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e907eabe-cc1a-401c-b63c-7bbf446c1d8d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1723 microversion: 2.20 time: 0.157499 Aug 30 16:03:37.087858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 281/559] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:36 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:37.340941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-a8dcb87d-841c-4088-9c24-266c385ed5ae req-600af489-25b1-42c9-bf57-f16ebcf140c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54113782-135e-4dda-a0e9-600a7fa1ec9b", "name": "network-vif-deleted", "tag": "a4e46843-30d5-4c47-a664-977f95d77639"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:37.352467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a8dcb87d-841c-4088-9c24-266c385ed5ae req-600af489-25b1-42c9-bf57-f16ebcf140c2 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:37.352942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a8dcb87d-841c-4088-9c24-266c385ed5ae req-600af489-25b1-42c9-bf57-f16ebcf140c2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:37.353407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-a8dcb87d-841c-4088-9c24-266c385ed5ae req-600af489-25b1-42c9-bf57-f16ebcf140c2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:37.367804 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-a8dcb87d-841c-4088-9c24-266c385ed5ae req-600af489-25b1-42c9-bf57-f16ebcf140c2 service nova] Creating event network-vif-deleted:a4e46843-30d5-4c47-a664-977f95d77639 for instance 54113782-135e-4dda-a0e9-600a7fa1ec9b on hv-cinder-85505 Aug 30 16:03:37.373094 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-a8dcb87d-841c-4088-9c24-266c385ed5ae req-600af489-25b1-42c9-bf57-f16ebcf140c2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035959 Aug 30 16:03:37.376845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 279/560] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:38.101596 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:38.102819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:38.110476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:38.110972 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:38.111563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:38.118141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:38.122589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:38.123035 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:38.155661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:38.156144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:38.156573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:38.157017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lazy-loading 'fault' on Instance uuid 54113782-135e-4dda-a0e9-600a7fa1ec9b {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:03:38.207487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:38.216685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:38.218331 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:38.219578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ddadc976-5824-4ed0-abf1-3015afcf9abc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 200 len: 1371 microversion: 2.20 time: 0.123093 Aug 30 16:03:38.220211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 282/561] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:38 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 1371 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:39.249403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:39.250677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:39.260559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:39.261039 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:39.261506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:39.262199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:39.262647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:39.263068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:39.276543 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] HTTP exception thrown: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Request method failure captured: Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b HTTP/1.1 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPaHdK5lBeqjTm3J0FhGPaH9kpPjDxsUJVOF_GEIvey2jQISaSU_NE3BinnHA0oQ_cxdMzGk_L6VjQM-RPDRNk1U_m6l2TcD9jIlgashTP3s0m4p3nLl5DHcTAa0YopuoYq0fhBbqCDyz5Pl9VKXUKp6WJd3-U2Z9ngZj5Vr17iSfE Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 6550878193fa4088861f08552a276578 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:03:39.278209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6550878193fa4088861f08552a276578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6550878193fa4088861f08552a276578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 6550878193fa4088861f08552a276578 Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 252dd6215082420cade91b100c73f100 Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:03:39.279959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '54113782-135e-4dda-a0e9-600a7fa1ec9b'} Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:03:39.280888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:03:39.282421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:03:39.283856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Returning 404 to user: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:03:39.283856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2110fcac-6834-4ede-94ae-8b1f2586b3da tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 404 len: 111 microversion: 2.20 time: 0.037401 Aug 30 16:03:39.283856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 280/562] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:39 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:03:39.288794 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8b4f2701-1f99-422a-9c8f-187dc4031e70 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '.version_select at 0x7f484806e9d0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:39.311082 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8b4f2701-1f99-422a-9c8f-187dc4031e70 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398166978" status: 204 len: 0 microversion: 2.20 time: 0.026047 Aug 30 16:03:39.311645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 283/563] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Aug 30 16:03:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1398166978 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:03:39.968077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a3cf4b7a-a487-404d-82d6-425576f6a01f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'create', calling method: .version_select at 0x7f4843f3c790>, body: {"keypair": {"name": "tempest-keypair-1149114560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNlnS+TfiNiPQbgpqHcKOxIDjC/haTVJ1iPAPgEpg3Aoqy/69E9slfVqPX9x4jBeD2XdPkl8EUw2F5zUMT6lAumdboSqXXdx8Gcv6/g/k4rAmLja1I0sqnqx0zhzrubx8w=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:39.987041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-a3cf4b7a-a487-404d-82d6-425576f6a01f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for project 6550878193fa4088861f08552a276578. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:03:39.991273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-a3cf4b7a-a487-404d-82d6-425576f6a01f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for user 252dd6215082420cade91b100c73f100 and project 6550878193fa4088861f08552a276578. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:03:40.016909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a3cf4b7a-a487-404d-82d6-425576f6a01f tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053379 Aug 30 16:03:40.017542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 281/564] 10.222.0.20 () {62 vars in 1200 bytes} [Tue Aug 30 16:03:39 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Aug 30 16:03:41.343690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2118256345", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "bb9cf09a-0cb8-4bf0-81f6-85b8ea0f47e0"}], "security_groups": [{"name": "tempest-securitygroup--616466717"}], "key_name": "tempest-keypair-1149114560", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:41.457621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] validate_networks() for [('bb9cf09a-0cb8-4bf0-81f6-85b8ea0f47e0', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:03:41.836572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:03:41.836995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:03:41.837590 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:03:41.837994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:03:41.838402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:03:41.847295 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:41.847770 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:41.848203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:41.848921 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:41.849400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:41.849823 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:41.867026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for project 6550878193fa4088861f08552a276578. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:03:41.871211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Getting quotas for user 252dd6215082420cade91b100c73f100 and project 6550878193fa4088861f08552a276578. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:03:41.882566 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:03:41.884874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:03:41.933401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4048dbe5-88d4-42de-88eb-3939f139e47e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.594577 Aug 30 16:03:41.934027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 284/565] 10.222.0.20 () {62 vars in 1188 bytes} [Tue Aug 30 16:03:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 30 16:03:41.945810 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54402ad5-cc6a-4613-bec4-6685ceb00616 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:41.946456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54402ad5-cc6a-4613-bec4-6685ceb00616 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:42.007802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-54402ad5-cc6a-4613-bec4-6685ceb00616 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:42.016083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-54402ad5-cc6a-4613-bec4-6685ceb00616 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:42.018005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-54402ad5-cc6a-4613-bec4-6685ceb00616 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:42.019103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54402ad5-cc6a-4613-bec4-6685ceb00616 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1282 microversion: 2.20 time: 0.077959 Aug 30 16:03:42.019661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 282/566] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:41 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1282 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:43.048034 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:43.048911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:43.060542 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:43.061425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:43.062144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:43.063286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:43.064031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:43.064734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:43.132811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:43.141411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:43.142854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:43.143958 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-df08d9df-7e2f-4529-a997-6cd7fc39c25b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1334 microversion: 2.20 time: 0.104214 Aug 30 16:03:43.144522 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 285/567] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:43 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1334 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:44.166543 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:44.167152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:44.174140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:44.174758 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:44.175268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:44.176058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:44.176584 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:44.177244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:44.314258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:44.329918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:44.331329 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:44.332511 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1f3819d-56e5-4c9e-9a95-7cd9ae2562af tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.169984 Aug 30 16:03:44.338338 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 283/568] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:44 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:44.997561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-0364ae4f-37f2-4482-8599-87de424f98f2 req-2a89b31e-cb31-483a-b962-a326b6c966eb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:45.006999 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=56,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:45.009159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0364ae4f-37f2-4482-8599-87de424f98f2 req-2a89b31e-cb31-483a-b962-a326b6c966eb service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:45.009888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0364ae4f-37f2-4482-8599-87de424f98f2 req-2a89b31e-cb31-483a-b962-a326b6c966eb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:45.010568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-0364ae4f-37f2-4482-8599-87de424f98f2 req-2a89b31e-cb31-483a-b962-a326b6c966eb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:45.023454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-0364ae4f-37f2-4482-8599-87de424f98f2 req-2a89b31e-cb31-483a-b962-a326b6c966eb service nova] Creating event network-changed:d0d1588a-51b6-424d-ad20-5fcdc6d3f397 for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 on hv-cinder-85505 Aug 30 16:03:45.028673 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-0364ae4f-37f2-4482-8599-87de424f98f2 req-2a89b31e-cb31-483a-b962-a326b6c966eb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035039 Aug 30 16:03:45.029863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 286/569] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:45.356663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:45.357271 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:45.364560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:45.365045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:45.365505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:45.366208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:45.366661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:45.367092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:45.498666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:45.506886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:45.508341 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:45.509471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ffc46f8f-4f28-4444-87e3-8c3bb664e3cb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.157363 Aug 30 16:03:45.510029 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 284/570] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:45 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:46.532595 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:46.533309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:46.542383 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:46.542867 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:46.543300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:46.544020 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:46.544469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:46.544886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:46.684101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:46.692673 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:46.694185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:46.695269 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d47bb183-f17c-406f-a16f-e55d1bdb9b6c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.167861 Aug 30 16:03:46.695798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 287/571] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:46 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:47.722129 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:47.723097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:47.734802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:47.735597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:47.736299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:47.737469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:47.738203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:47.738889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:47.881545 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:47.894214 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:47.896421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:47.898071 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8ec06a23-5ddc-49be-97bd-fdf89998159d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.182219 Aug 30 16:03:47.898791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 285/572] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:47 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:48.923926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:48.924828 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:48.935241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:48.935966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:48.936609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:48.937788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:48.938474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:48.939106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:49.076746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:49.085374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:49.086848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:49.087957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c8de33b0-b6a7-46a5-8bbf-ddb1721c7c74 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.170213 Aug 30 16:03:49.088510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 288/573] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:48 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:50.115199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:50.116056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:50.125003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:50.125488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:50.125906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:50.126591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:50.127041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:50.127451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:50.260473 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:50.269440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:50.270905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:50.272012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6df8c2d6-4cd9-4763-a9e8-53bfdf1e342a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.164579 Aug 30 16:03:50.272581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 286/574] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:50 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:50.731545 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-04bb49ee-687d-478c-bb35-570e873113eb req-325b6391-6681-4af6-8b81-ae5a2d1250c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "name": "network-vif-plugged", "status": "completed", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:50.742472 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-04bb49ee-687d-478c-bb35-570e873113eb req-325b6391-6681-4af6-8b81-ae5a2d1250c6 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:50.742968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-04bb49ee-687d-478c-bb35-570e873113eb req-325b6391-6681-4af6-8b81-ae5a2d1250c6 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:50.743436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-04bb49ee-687d-478c-bb35-570e873113eb req-325b6391-6681-4af6-8b81-ae5a2d1250c6 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:50.755256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-04bb49ee-687d-478c-bb35-570e873113eb req-325b6391-6681-4af6-8b81-ae5a2d1250c6 service nova] Creating event network-vif-plugged:d0d1588a-51b6-424d-ad20-5fcdc6d3f397 for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 on hv-cinder-85505 Aug 30 16:03:50.760103 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-04bb49ee-687d-478c-bb35-570e873113eb req-325b6391-6681-4af6-8b81-ae5a2d1250c6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032368 Aug 30 16:03:50.760668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 289/575] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:51.298801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:51.299713 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:51.310561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:51.311048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:51.311481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:51.312166 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:51.312596 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:51.313047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:51.458234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:51.466659 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:51.468104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:51.469236 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fe6323a6-dc67-4f75-a793-3f511efa302d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.177197 Aug 30 16:03:51.469809 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 287/576] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:51 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:52.492146 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.493582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:52.500960 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:52.502150 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:52.513820 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:52.514678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:52.515105 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:52.515788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:52.516235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:52.516649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:52.653288 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:52.666056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:52.668224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:52.669978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b46f22ba-f1a4-4a81-8046-fe630921d90e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1407 microversion: 2.20 time: 0.180011 Aug 30 16:03:52.670687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 290/577] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:52 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:53.696917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:53.697846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:53.701438 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:03:53.712829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:53.713691 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:53.714414 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:53.715577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:53.716324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:53.717023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:53.853306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:53.863853 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:53.865319 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:03:53.866472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-caabc343-e360-489f-aee4-28086ce71dd7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1599 microversion: 2.20 time: 0.176173 Aug 30 16:03:53.867031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 288/578] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:03:53 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1599 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:03:53.888858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:53.889443 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:53.899791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:53.901210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:53.902116 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:53.903590 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:53.904347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:53.905059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:53.988269 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f069d557-adfc-4d48-a9dd-43266be3f9e4 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.103062 Aug 30 16:03:53.989186 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 291/579] 10.222.0.20 () {60 vars in 1316 bytes} [Tue Aug 30 16:03:53 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:03:55.187269 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3b67fc91-50f8-4e49-a27f-70eb0096d78a req-66ecbdfd-9f25-41df-b2dd-f95fe08363bd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:55.197494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3b67fc91-50f8-4e49-a27f-70eb0096d78a req-66ecbdfd-9f25-41df-b2dd-f95fe08363bd service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.197972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3b67fc91-50f8-4e49-a27f-70eb0096d78a req-66ecbdfd-9f25-41df-b2dd-f95fe08363bd service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.198395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3b67fc91-50f8-4e49-a27f-70eb0096d78a req-66ecbdfd-9f25-41df-b2dd-f95fe08363bd service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.209583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3b67fc91-50f8-4e49-a27f-70eb0096d78a req-66ecbdfd-9f25-41df-b2dd-f95fe08363bd service nova] Creating event network-changed:d0d1588a-51b6-424d-ad20-5fcdc6d3f397 for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 on hv-cinder-85505 Aug 30 16:03:55.214846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3b67fc91-50f8-4e49-a27f-70eb0096d78a req-66ecbdfd-9f25-41df-b2dd-f95fe08363bd service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031390 Aug 30 16:03:55.215999 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 289/580] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:55.650310 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:03:55.650759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:55.658160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.658900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.659544 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.660214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:55.660659 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:55.661257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:55.686322 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d148e64e-39e6-4db7-95d4-04a813f29ba2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/ips" status: 200 len: 150 microversion: 2.1 time: 0.039775 Aug 30 16:03:55.687285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 292/581] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:03:55 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:03:57.079674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:03:57.082109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:03:57.089422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:57.089902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:57.090330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:57.090982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:03:57.091624 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:03:57.091876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:03:57.381359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-63599ef8-e539-4fff-9449-40c7258cb2ad tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.305904 Aug 30 16:03:57.381987 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 290/582] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:03:57 2022] POST /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:04.960732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:04.963141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:04.969900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:04.970382 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:04.970804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:04.971492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:04.971935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:04.972353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:04.974762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=66 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.055330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Invalid volume: volume b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a is already attached to instances: dbff92f4-6c46-464b-93ac-6d56f92d2395 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: POST /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments HTTP/1.1 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 74 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:04:05.057101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {"volumeAttachment": {"volumeId": "b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a"}} Aug 30 16:04:05.058530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Invalid volume: volume b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a is already attached to instances: dbff92f4-6c46-464b-93ac-6d56f92d2395 Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'server_id': 'dbff92f4-6c46-464b-93ac-6d56f92d2395', 'body': {'volumeAttachment': {'volumeId': 'b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a'}}} Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5128, in attach_volume Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4968, in _check_volume_already_attached Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a is already attached to instances: dbff92f4-6c46-464b-93ac-6d56f92d2395 Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:05.059297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a is already attached to instances: dbff92f4-6c46-464b-93ac-6d56f92d2395 Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:05.060516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a is already attached to instances: dbff92f4-6c46-464b-93ac-6d56f92d2395 Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 400 to user: Invalid volume: volume b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a is already attached to instances: dbff92f4-6c46-464b-93ac-6d56f92d2395 {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f013323e-05f0-46f3-be63-7cd67a777d3b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.102042 Aug 30 16:04:05.061793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 293/583] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:04:04 2022] POST /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:04:05.126197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:05.126775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:05.128766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.134852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:05.135382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:05.135814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:05.136498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:05.136944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:05.137502 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:05.140506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=62,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:05.222316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'services' on Instance uuid dbff92f4-6c46-464b-93ac-6d56f92d2395 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:05.301769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-819cef08-d0ca-4d01-ba1e-8df6f90e423d tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments/b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a" status: 202 len: 0 microversion: 2.1 time: 0.180385 Aug 30 16:04:05.302407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 291/584] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:04:05 2022] DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments/b03a9c96-e3e8-4cb4-ac0a-bee0a0066a0a => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:04:05.311685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:05.313997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:05.321309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:05.321870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:05.322376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:05.323126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:05.323588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:05.324164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:05.355464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-064cf788-2f5c-42dc-81f1-0b6b4542dba0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048068 Aug 30 16:04:05.356013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 294/585] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:04:05 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:06.369128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:06.371483 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:06.377950 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.378740 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.379217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.379943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.380385 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.380823 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.411091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-480a06b7-5aa0-40ca-9036-c21d648c2c60 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046524 Aug 30 16:04:06.411645 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 292/586] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:04:06 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:06.417044 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:06.417744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:06.424309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.424794 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.425347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.426033 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.426646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.427068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.475314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:06.475801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:06.482530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.483038 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.483457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.484480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.484922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.485373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.510751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:06.548722 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lazy-loading 'services' on Instance uuid 6b410390-11de-461d-ae41-a8f036f5d694 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:06.589705 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb343955-ae4a-4884-b2db-f4c3d0cdfbf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 204 len: 0 microversion: 2.1 time: 0.117984 Aug 30 16:04:06.590344 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 293/587] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:06 2022] DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:06.599946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:06.600633 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:06.606647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.607126 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.607552 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.608233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.608670 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.609454 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.670934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2b77b59c-66e1-407b-9414-771d48b2cc0a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments/af70bde1-6af7-4f96-a222-984f2ff125c2" status: 202 len: 0 microversion: 2.1 time: 0.258143 Aug 30 16:04:06.671432 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 295/588] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:04:06 2022] DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments/af70bde1-6af7-4f96-a222-984f2ff125c2 => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:04:06.680238 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:06.682616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:06.688958 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.689470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.689901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.690602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:06.691108 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:06.691913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:06.722654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3bbab14e-5594-4595-ad9f-f5df07139ffd tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046472 Aug 30 16:04:06.723228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 296/589] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:04:06 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:06.752275 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:06.760857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a509827-b715-42cb-a661-1e2d4d768002 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1679 microversion: 2.1 time: 0.165992 Aug 30 16:04:06.761521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 294/590] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:06 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1679 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:07.738497 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:07.740872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:07.748401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:07.748945 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:07.749473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:07.750234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:07.750731 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:07.751197 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:07.782186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:07.782739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-89d7be80-50fc-43c4-b31e-75986bdf2b88 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050199 Aug 30 16:04:07.782857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:07.783108 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 297/591] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:04:07 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:07.789757 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:07.790232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:07.790655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:07.791340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:07.791783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:07.792197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:07.923520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:07.931551 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-246f434f-2971-4d9c-a7c6-997f85ad33b8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1679 microversion: 2.1 time: 0.153276 Aug 30 16:04:07.932116 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 295/592] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:07 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:08.794707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:08.796881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:08.805516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.806004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.806410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:08.807126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.807754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.808174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:08.843125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-01091fe3-8a2a-4804-8138-847400fbf6f9 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052361 Aug 30 16:04:08.843711 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 298/593] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:04:08 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:08.952394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:08.953073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:08.959679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.960357 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.960798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:08.961510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:08.961958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:08.962374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:09.269806 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:09.277842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1d70983-c50f-42b7-ae2b-949bef5516dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1679 microversion: 2.1 time: 0.329656 Aug 30 16:04:09.278509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 296/594] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:08 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1679 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:09.616323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-d4f84589-93fa-497a-9b76-71d07b406dfb req-57240c58-7b69-4f93-9025-aa2f8d738977 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbff92f4-6c46-464b-93ac-6d56f92d2395", "name": "network-vif-deleted", "tag": "926d2182-901e-47cb-a1ce-48a18173cf88"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:09.626933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d4f84589-93fa-497a-9b76-71d07b406dfb req-57240c58-7b69-4f93-9025-aa2f8d738977 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:09.627406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d4f84589-93fa-497a-9b76-71d07b406dfb req-57240c58-7b69-4f93-9025-aa2f8d738977 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:09.627825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-d4f84589-93fa-497a-9b76-71d07b406dfb req-57240c58-7b69-4f93-9025-aa2f8d738977 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:09.640546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-d4f84589-93fa-497a-9b76-71d07b406dfb req-57240c58-7b69-4f93-9025-aa2f8d738977 service nova] Creating event network-vif-deleted:926d2182-901e-47cb-a1ce-48a18173cf88 for instance dbff92f4-6c46-464b-93ac-6d56f92d2395 on hv-cinder-85505 Aug 30 16:04:09.646319 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-d4f84589-93fa-497a-9b76-71d07b406dfb req-57240c58-7b69-4f93-9025-aa2f8d738977 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034327 Aug 30 16:04:09.646972 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 299/595] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:09.856842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:09.859720 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:09.865814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:09.866553 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:09.867073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:09.867836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:09.868498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:09.869188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:09.900979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5dcc11ba-ffa2-487a-8d4c-4a894f3da960 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048085 Aug 30 16:04:09.901815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 297/596] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:04:09 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:04:09.978958 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:09.980159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:09.986795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:09.987493 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:09.988222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:09.989279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:09.989882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:09.990476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.017172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:10.096193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-25ff7152-70d6-4665-93ed-46bf60ba0156 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 204 len: 0 microversion: 2.1 time: 0.123912 Aug 30 16:04:10.096802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 300/597] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:09 2022] DELETE /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:10.104897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:10.105522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:10.112380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.112922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.113410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.114108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.114556 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.114970 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.246160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:10.256120 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6e7ff9ef-0919-4dca-87bd-bfa97a450939 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1690 microversion: 2.1 time: 0.154938 Aug 30 16:04:10.258043 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 298/598] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:10 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1690 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:10.299303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:10.300023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:10.306376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.306858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.307286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.307967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.308411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.308837 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.343444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:10.343918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:10.344336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:10.344768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid dbff92f4-6c46-464b-93ac-6d56f92d2395 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:10.448405 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:10.456434 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8be3017f-d5fb-4753-b9dc-186e0710e096 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1330 microversion: 2.1 time: 0.161578 Aug 30 16:04:10.457002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 301/599] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:10 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1330 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:11.284590 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:11.285147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:11.292278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.292765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.293254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.293962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.294413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.294838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.428036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:11.436016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fba49c4f-c579-48e5-a5b0-e3c8d6435c22 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1690 microversion: 2.1 time: 0.158201 Aug 30 16:04:11.436587 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 299/600] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1690 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:11.476583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:11.477183 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:11.484349 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.484820 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.485258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.485935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.486372 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.486781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.518020 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:11.518512 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:11.518973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:11.519435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid dbff92f4-6c46-464b-93ac-6d56f92d2395 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:11.566798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:11.574668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b7099dbb-70f1-4eaa-b1f8-b030422a8bf7 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1330 microversion: 2.1 time: 0.101978 Aug 30 16:04:11.575224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 302/601] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:11 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1330 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:12.459597 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.460287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:12.468243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.468807 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.469346 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.470147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.470668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.471156 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.594914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:12.595525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:12.604604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.605102 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.605550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.606228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.606667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.607080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.609495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:12.617816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a783f84a-29cb-44fb-880d-fd258f1efda3 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1690 microversion: 2.1 time: 0.163924 Aug 30 16:04:12.618929 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 300/602] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:12 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1690 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:12.640765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:12.641272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:12.641696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:12.642161 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid dbff92f4-6c46-464b-93ac-6d56f92d2395 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:12.688056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:12.695991 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c514d028-9d44-439b-8331-87a27c63e03a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 200 len: 1330 microversion: 2.1 time: 0.105102 Aug 30 16:04:12.696557 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 303/603] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:12 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:13.639859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:13.641281 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:13.649202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:13.649712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:13.650135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:13.650825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:13.651267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:13.651705 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:13.720483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:13.721110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:13.727669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:13.728147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:13.728568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:13.729281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:13.729727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:13.730142 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:13.744860 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 HTTP/1.1 Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:04:13.746672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:04:13.747997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': 'dbff92f4-6c46-464b-93ac-6d56f92d2395'} Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:13.748762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:04:13.750387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:13.751852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:13.751852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f58070dd-b602-41ad-bc74-4d19bb01e304 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 404 len: 111 microversion: 2.1 time: 0.035767 Aug 30 16:04:13.751852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 304/604] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:13 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:13.757561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f084306e-a86d-40dd-89cb-b8c55736d4b2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '.version_select at 0x7f48480cf550>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:13.780782 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f084306e-a86d-40dd-89cb-b8c55736d4b2 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-960906845" status: 202 len: 0 microversion: 2.1 time: 0.027074 Aug 30 16:04:13.784122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:13.785779 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 305/605] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 30 16:04:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-960906845 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:04:13.792619 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-65287951-8cd7-40b4-83dd-a16894038014 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1690 microversion: 2.1 time: 0.157059 Aug 30 16:04:13.806379 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 301/606] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:13 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1690 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:14.419477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dc39c74e-d493-46d4-9a3e-f42c71f9947e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: .version_select at 0x7f4848113310>, body: {"keypair": {"name": "tempest-keypair-821494006", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDONUBUZqdArbFVt03Ocs5Ys5FSaSaJyLhsjMCQXEQKlNQw6xH3+8XpRSpnKwROd8FX0dUuxk2vLQjznbWm+deSBypps+ROJJ7oy2Dq4u+OVzYYPYantXGP2pwJNNEXxuQ=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:14.435601 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-dc39c74e-d493-46d4-9a3e-f42c71f9947e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:14.439590 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-dc39c74e-d493-46d4-9a3e-f42c71f9947e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:14.462709 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dc39c74e-d493-46d4-9a3e-f42c71f9947e tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047007 Aug 30 16:04:14.463284 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 306/607] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:04:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:14.626323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2ffff349-9697-4245-b39d-0e7ca72f06e1 req-b2aedd48-e4f5-4fdc-8935-231a1d5da7bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6b410390-11de-461d-ae41-a8f036f5d694", "name": "network-vif-deleted", "tag": "7fb957c8-4f9b-4421-b9ac-197b68f7a10e"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:14.658842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ffff349-9697-4245-b39d-0e7ca72f06e1 req-b2aedd48-e4f5-4fdc-8935-231a1d5da7bb service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.663340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ffff349-9697-4245-b39d-0e7ca72f06e1 req-b2aedd48-e4f5-4fdc-8935-231a1d5da7bb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.665045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ffff349-9697-4245-b39d-0e7ca72f06e1 req-b2aedd48-e4f5-4fdc-8935-231a1d5da7bb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.679915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2ffff349-9697-4245-b39d-0e7ca72f06e1 req-b2aedd48-e4f5-4fdc-8935-231a1d5da7bb service nova] Creating event network-vif-deleted:7fb957c8-4f9b-4421-b9ac-197b68f7a10e for instance 6b410390-11de-461d-ae41-a8f036f5d694 on hv-cinder-85505 Aug 30 16:04:14.685558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2ffff349-9697-4245-b39d-0e7ca72f06e1 req-b2aedd48-e4f5-4fdc-8935-231a1d5da7bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062928 Aug 30 16:04:14.686850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 302/608] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:14.813956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:14.814550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:14.824165 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.828763 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.829523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.830461 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.831119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.833057 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.871940 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:14.872495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:14.873124 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:14.873749 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lazy-loading 'fault' on Instance uuid 6b410390-11de-461d-ae41-a8f036f5d694 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:14.953036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:14.963425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-693a3100-a002-42e1-b2b5-afa21ae7c1dc tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 200 len: 1336 microversion: 2.1 time: 0.153306 Aug 30 16:04:14.964492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 307/609] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:14 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 1336 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:15.898489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1050784246", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b3aa7438-61b4-41af-81a0-39b48f126de4"}], "security_groups": [{"name": "tempest-securitygroup--1787397132"}], "key_name": "tempest-keypair-821494006", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:15.985066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:15.985677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 6b410390-11de-461d-ae41-a8f036f5d694] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:15.992002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:15.992478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:15.993260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:15.993976 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:15.994420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:15.994831 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:16.004579 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] validate_networks() for [('b3aa7438-61b4-41af-81a0-39b48f126de4', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:04:16.008547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] HTTP exception thrown: Instance 6b410390-11de-461d-ae41-a8f036f5d694 could not be found. Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Request method failure captured: Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 HTTP/1.1 Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPbErh-lB5Rzlrt__YAi7syzEIzJE3yxDpiA5zbNCOrdVke1rtd2l_gAtR9dNM50llV3cAqlovCsNO5_om48W_hTZXnsSe27UOQdEFxyENhLjzUjAxkuy0_M3r2mOeT3E7C3kvowrhlBvNMeP2gsFJCVoMgg47z2rk4Y9zVIzJl77g Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:04:16.010203 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: c34836a75f144f74aa3fd6a38ccb9791 Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 6b410390-11de-461d-ae41-a8f036f5d694 could not be found. Aug 30 16:04:16.011641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '6b410390-11de-461d-ae41-a8f036f5d694'} Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6b410390-11de-461d-ae41-a8f036f5d694 could not be found. Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:16.012408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6b410390-11de-461d-ae41-a8f036f5d694 could not be found. Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6b410390-11de-461d-ae41-a8f036f5d694 could not be found. Aug 30 16:04:16.013661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:16.014691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Returning 404 to user: Instance 6b410390-11de-461d-ae41-a8f036f5d694 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:16.014691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f4cde6b7-9087-4f8d-91e2-739f9b2ebb98 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694" status: 404 len: 111 microversion: 2.1 time: 0.030900 Aug 30 16:04:16.014691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 308/610] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:15 2022] GET /compute/v2.1/servers/6b410390-11de-461d-ae41-a8f036f5d694 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:04:16.020085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-afdd840d-49b5-49d0-a466-9317ee012cf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '.version_select at 0x7f484802b5e0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.040045 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-afdd840d-49b5-49d0-a466-9317ee012cf4 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283955912" status: 202 len: 0 microversion: 2.1 time: 0.023473 Aug 30 16:04:16.040816 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 309/611] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 30 16:04:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1283955912 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:04:16.558348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:04:16.558763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:04:16.559230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:04:16.559690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:04:16.560146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:04:16.570384 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:16.570871 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:16.571287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:16.572005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:16.572451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:16.572868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:16.590448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:04:16.594847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Getting quotas for user b133ae684f20468f982ae0c25020d837 and project 2c2aad2014bc4db49a818a6926f860d5. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:04:16.607127 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:04:16.610005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:04:16.662093 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d8b04a6-ebe0-4576-99a8-a6a81af2eb0b tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.769352 Aug 30 16:04:16.662945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 303/612] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:04:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:04:16.673810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c1acc70f-12b7-4fc5-ba4a-13d172990966 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:16.674403 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c1acc70f-12b7-4fc5-ba4a-13d172990966 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:16.680338 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:16.778790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c1acc70f-12b7-4fc5-ba4a-13d172990966 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:16.786325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c1acc70f-12b7-4fc5-ba4a-13d172990966 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1241 microversion: 2.1 time: 0.116356 Aug 30 16:04:16.799119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 310/613] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:16 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1241 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:17.806784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:17.807355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:17.814671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:17.815149 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:17.815582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:17.816269 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:17.817613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:17.818119 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:17.894195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:17.903707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3df0797f-0909-4f95-b71c-00812aaf5cd1 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1293 microversion: 2.1 time: 0.100818 Aug 30 16:04:17.904292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 304/614] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:17 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1293 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:18.924763 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:18.925987 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:18.932182 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.932748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.933260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:18.934018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:18.934672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:18.935226 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.131904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:19.132495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:19.138931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.139415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.139825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.140508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.140944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.141372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.167257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:19.200789 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.217245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:19.226722 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-628319d3-5cdb-44bb-9e10-d455025ba1da tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.306588 Aug 30 16:04:19.227600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 311/615] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:18 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:19.253323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3dd52c56-45fb-42a3-b714-0eece28aec68 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 204 len: 0 microversion: 2.1 time: 0.125202 Aug 30 16:04:19.254131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 305/616] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:19 2022] DELETE /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:04:19.262369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:19.263148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:19.269245 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.269835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.270366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.271154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.271744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.272248 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.276464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:19.498556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:19.506823 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-74562c36-aa50-4af2-b921-7bb03022fc00 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1507 microversion: 2.1 time: 0.248443 Aug 30 16:04:19.507405 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 312/617] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:19 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1507 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:19.615200 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-664d09e8-cbc9-4539-b7ed-496b6343d35e req-1e9a304d-84d8-475a-a99e-6bfe419141f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360d09f7-80fb-4478-959b-aac5113ef49f", "tag": "02b08cac-c391-4e35-90bb-f9f633db4707"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:19.624764 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-664d09e8-cbc9-4539-b7ed-496b6343d35e req-1e9a304d-84d8-475a-a99e-6bfe419141f6 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:19.625241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-664d09e8-cbc9-4539-b7ed-496b6343d35e req-1e9a304d-84d8-475a-a99e-6bfe419141f6 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:19.625669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-664d09e8-cbc9-4539-b7ed-496b6343d35e req-1e9a304d-84d8-475a-a99e-6bfe419141f6 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:19.638377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-664d09e8-cbc9-4539-b7ed-496b6343d35e req-1e9a304d-84d8-475a-a99e-6bfe419141f6 service nova] Creating event network-changed:02b08cac-c391-4e35-90bb-f9f633db4707 for instance 360d09f7-80fb-4478-959b-aac5113ef49f on hv-cinder-85505 Aug 30 16:04:19.643241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-664d09e8-cbc9-4539-b7ed-496b6343d35e req-1e9a304d-84d8-475a-a99e-6bfe419141f6 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032231 Aug 30 16:04:19.644186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 306/618] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:20.252426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:20.253603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:20.261151 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:20.261661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:20.262084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:20.262763 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:20.263210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:20.263616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:20.402926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:20.410930 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f69c1679-ea2c-4072-a91a-52d8c47daecc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.165031 Aug 30 16:04:20.411728 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 313/619] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:20 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:20.534374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:20.535343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:20.545899 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:20.546653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:20.547417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:20.548546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:20.549283 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:20.550046 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:20.698148 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:20.705933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8fb646cc-f646-48bc-8f06-a97ae7853ae0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1507 microversion: 2.1 time: 0.179969 Aug 30 16:04:20.706520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 307/620] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:20 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1507 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:21.435549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:21.436548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:21.447799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:21.448586 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:21.449321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.450457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:21.451190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:21.451865 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.610481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:21.622383 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d31ae743-de85-4d09-8d00-916808301adf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.193106 Aug 30 16:04:21.623248 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 314/621] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:21 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:21.727859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:21.728606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:21.738035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:21.738686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:21.739267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.740191 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:21.740790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:21.741394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:21.880738 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:21.892232 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a794fdcb-5902-4183-922c-b9a7d0a284f6 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1507 microversion: 2.1 time: 0.169430 Aug 30 16:04:21.905062 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 308/622] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:21 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1507 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:22.371025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-f4edcba0-490d-4618-b668-837f67b3c74f req-3b1989f1-3f82-4512-a01d-1ecfd1d029ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8c672ab4-9099-40f4-a9ae-afc15962175d", "name": "network-vif-deleted", "tag": "82b53a6b-1338-44eb-92b3-eba0281b22f0"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:22.381267 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f4edcba0-490d-4618-b668-837f67b3c74f req-3b1989f1-3f82-4512-a01d-1ecfd1d029ad service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.381830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f4edcba0-490d-4618-b668-837f67b3c74f req-3b1989f1-3f82-4512-a01d-1ecfd1d029ad service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.382258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f4edcba0-490d-4618-b668-837f67b3c74f req-3b1989f1-3f82-4512-a01d-1ecfd1d029ad service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.393898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-f4edcba0-490d-4618-b668-837f67b3c74f req-3b1989f1-3f82-4512-a01d-1ecfd1d029ad service nova] Creating event network-vif-deleted:82b53a6b-1338-44eb-92b3-eba0281b22f0 for instance 8c672ab4-9099-40f4-a9ae-afc15962175d on hv-cinder-85505 Aug 30 16:04:22.399232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-f4edcba0-490d-4618-b668-837f67b3c74f req-3b1989f1-3f82-4512-a01d-1ecfd1d029ad service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031972 Aug 30 16:04:22.400122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 315/623] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:22.643915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:22.644821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:22.651877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.652345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.652769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.653491 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.653937 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.654342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.913881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:22.914490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:22.921472 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.921957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.922380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.923079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.923521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.923933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.956794 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:22.957353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:22.957846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:22.958314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lazy-loading 'fault' on Instance uuid 8c672ab4-9099-40f4-a9ae-afc15962175d {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:23.043975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:23.052259 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-30cbf86f-c740-421c-ad28-b0cb70aab61d tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 200 len: 1312 microversion: 2.1 time: 0.142790 Aug 30 16:04:23.052835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 316/624] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:22 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 1312 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:04:23.104199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:23.115564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c77079d-6402-44f5-a2e1-5e17553cc37a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.475925 Aug 30 16:04:23.116434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 309/625] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:22 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:24.137844 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:24.138471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:24.140657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:24.141521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 8c672ab4-9099-40f4-a9ae-afc15962175d] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:24.147140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.147626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.148044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.148727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.148868 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.149165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.149360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.149674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.149822 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.150436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.150870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.151279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.166340 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] HTTP exception thrown: Instance 8c672ab4-9099-40f4-a9ae-afc15962175d could not be found. Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Request method failure captured: Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d HTTP/1.1 Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPbErh-lB5Rzlrt__YAi7syzEIzJE3yxDpiA5zbNCOrdVke1rtd2l_gAtR9dNM50llV3cAqlovCsNO5_om48W_hTZXnsSe27UOQdEFxyENhLjzUjAxkuy0_M3r2mOeT3E7C3kvowrhlBvNMeP2gsFJCVoMgg47z2rk4Y9zVIzJl77g Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:04:24.168012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: c34836a75f144f74aa3fd6a38ccb9791 Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 8c672ab4-9099-40f4-a9ae-afc15962175d could not be found. Aug 30 16:04:24.169492 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '8c672ab4-9099-40f4-a9ae-afc15962175d'} Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8c672ab4-9099-40f4-a9ae-afc15962175d could not be found. Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:24.170369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8c672ab4-9099-40f4-a9ae-afc15962175d could not be found. Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8c672ab4-9099-40f4-a9ae-afc15962175d could not be found. Aug 30 16:04:24.171803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:24.173056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Returning 404 to user: Instance 8c672ab4-9099-40f4-a9ae-afc15962175d could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:24.173056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4db45085-ee46-4272-956c-8a93ad46e381 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d" status: 404 len: 111 microversion: 2.1 time: 0.100094 Aug 30 16:04:24.173056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 317/626] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:24 2022] GET /compute/v2.1/servers/8c672ab4-9099-40f4-a9ae-afc15962175d => generated 111 bytes in 102 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:04:24.177690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:24.178164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:24.183956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.184423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.184848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.185554 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.185999 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.186409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.214598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:04:24.291612 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:24.297826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0500ea35-6a0c-493e-83bb-9114e7324572 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 204 len: 0 microversion: 2.1 time: 0.123381 Aug 30 16:04:24.298600 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 318/627] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:04:24 2022] DELETE /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:24.300526 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a3b932e-8380-4576-ad25-17ced7f6bbf3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.168632 Aug 30 16:04:24.301101 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 310/628] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:24 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:24.306874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:24.307557 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:24.313479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.313959 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.314380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.315062 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:24.315510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:24.315913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:24.465442 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:24.476321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4740c026-3a90-4672-b759-c91071a1a78c tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.173505 Aug 30 16:04:24.476891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 319/629] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:24 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:25.325632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:25.326451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:25.335438 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.336091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.336662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.337660 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.338259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.338818 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.472924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:25.480793 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7c70ed1-7e73-4b22-bc34-97764db7e3fd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.160753 Aug 30 16:04:25.481403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 311/630] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:25 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:25.498856 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:25.499387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:25.506599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.507140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.507570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.508256 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:25.508706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:25.509125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:25.637371 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:25.645695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c21ccdee-0a33-426f-b23f-618350937fb0 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.152631 Aug 30 16:04:25.646247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 320/631] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:25 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:26.508455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:26.509391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:26.520544 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.521026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.521496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.522188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.522639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.523061 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.580606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.602044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.658422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:26.666734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1555da69-471d-42b2-99fa-315ad0d05854 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.164912 Aug 30 16:04:26.666936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:26.667400 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 312/632] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:26 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:26.667496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:26.674109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.674591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.675025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.675709 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:26.676157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:26.676613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:26.783411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:26.807131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:26.815018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8e3281ed-f299-4336-b6f9-48ae300cfbc5 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.152228 Aug 30 16:04:26.815609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 321/633] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:26 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:27.687578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:27.688142 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:27.695445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:27.695926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:27.696349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:27.697029 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:27.697490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:27.697908 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:27.835787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:27.836500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:27.843123 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:27.843603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:27.844041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:27.844723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:27.845188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:27.845602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:27.932154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:27.940803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d512d9be-f52a-454b-88eb-f0952f18962a tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.257360 Aug 30 16:04:27.941428 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 313/634] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:27 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:28.051278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c34836a75f144f74aa3fd6a38ccb9791', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10a598aa5be54fc29948da53d8ac7a32', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:28.059380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0478b706-7cc6-4a99-b17a-010d76b31279 tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 200 len: 1521 microversion: 2.1 time: 0.227736 Aug 30 16:04:28.060050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 322/635] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:27 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:28.218855 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-457fb6ee-04e8-4c11-940f-5805de2291da req-8d1a2a45-04ba-4a5b-9d4f-31580b350061 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9ab35a6d-8b8e-470e-8e4c-16ca84a742ac", "name": "network-vif-deleted", "tag": "2bbcacc7-84dc-4397-b945-2d07bb0b8639"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:28.232240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-457fb6ee-04e8-4c11-940f-5805de2291da req-8d1a2a45-04ba-4a5b-9d4f-31580b350061 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.232814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-457fb6ee-04e8-4c11-940f-5805de2291da req-8d1a2a45-04ba-4a5b-9d4f-31580b350061 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.233833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-457fb6ee-04e8-4c11-940f-5805de2291da req-8d1a2a45-04ba-4a5b-9d4f-31580b350061 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.249160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-457fb6ee-04e8-4c11-940f-5805de2291da req-8d1a2a45-04ba-4a5b-9d4f-31580b350061 service nova] Creating event network-vif-deleted:2bbcacc7-84dc-4397-b945-2d07bb0b8639 for instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac on hv-cinder-85505 Aug 30 16:04:28.256394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-457fb6ee-04e8-4c11-940f-5805de2291da req-8d1a2a45-04ba-4a5b-9d4f-31580b350061 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041255 Aug 30 16:04:28.257079 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 314/636] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:28.928166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-740a5702-a800-41a0-92d5-3ddb783a60fd req-1807d189-2706-45d8-8546-d4178aa86e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360d09f7-80fb-4478-959b-aac5113ef49f", "name": "network-vif-plugged", "status": "completed", "tag": "02b08cac-c391-4e35-90bb-f9f633db4707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:28.940166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-740a5702-a800-41a0-92d5-3ddb783a60fd req-1807d189-2706-45d8-8546-d4178aa86e12 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.940630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-740a5702-a800-41a0-92d5-3ddb783a60fd req-1807d189-2706-45d8-8546-d4178aa86e12 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.941038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-740a5702-a800-41a0-92d5-3ddb783a60fd req-1807d189-2706-45d8-8546-d4178aa86e12 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.953605 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-740a5702-a800-41a0-92d5-3ddb783a60fd req-1807d189-2706-45d8-8546-d4178aa86e12 service nova] Creating event network-vif-plugged:02b08cac-c391-4e35-90bb-f9f633db4707 for instance 360d09f7-80fb-4478-959b-aac5113ef49f on hv-cinder-85505 Aug 30 16:04:28.961359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-740a5702-a800-41a0-92d5-3ddb783a60fd req-1807d189-2706-45d8-8546-d4178aa86e12 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038080 Aug 30 16:04:28.962038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 323/637] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:04:28.962312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:28.963017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:28.969561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.970058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.970516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:28.971227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:28.971674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:28.972117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.081509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:29.082449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] [instance: 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:29.089518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:29.090139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:29.090564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.091426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:29.091876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:29.092285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:29.106109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] HTTP exception thrown: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac could not be found. Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Request method failure captured: Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac HTTP/1.1 Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPbErh-lB5Rzlrt__YAi7syzEIzJE3yxDpiA5zbNCOrdVke1rtd2l_gAtR9dNM50llV3cAqlovCsNO5_om48W_hTZXnsSe27UOQdEFxyENhLjzUjAxkuy0_M3r2mOeT3E7C3kvowrhlBvNMeP2gsFJCVoMgg47z2rk4Y9zVIzJl77g Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:04:29.107862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_10a598aa5be54fc29948da53d8ac7a32"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 10a598aa5be54fc29948da53d8ac7a32 Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-805443325 Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: c34836a75f144f74aa3fd6a38ccb9791 Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-ServerRescueNegativeTestJSON-805443325-project Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac could not be found. Aug 30 16:04:29.110780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '9ab35a6d-8b8e-470e-8e4c-16ca84a742ac'} Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac could not be found. Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:04:29.111657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac could not be found. Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac could not be found. Aug 30 16:04:29.112870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:04:29.114002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] Returning 404 to user: Instance 9ab35a6d-8b8e-470e-8e4c-16ca84a742ac could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:04:29.114002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cb34e024-6894-41ba-b8b0-8067d8ee917a tempest-ServerRescueNegativeTestJSON-805443325 tempest-ServerRescueNegativeTestJSON-805443325-project] 10.222.0.20 "GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac" status: 404 len: 111 microversion: 2.1 time: 0.033286 Aug 30 16:04:29.114002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 324/638] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:29 2022] GET /compute/v2.1/servers/9ab35a6d-8b8e-470e-8e4c-16ca84a742ac => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:04:29.118469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:29.127326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-90321ad8-09bb-4ef4-a927-7d7bfa90e083 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.169744 Aug 30 16:04:29.128871 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 315/639] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:28 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:30.152519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:30.153178 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:30.160407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.160863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.161300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.162005 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:30.162448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:30.162865 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:30.411684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:30.420042 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a6c0401a-bd59-47d8-9a61-a3f8f1c996dd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1367 microversion: 2.1 time: 0.271549 Aug 30 16:04:30.420616 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 325/640] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:30 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1367 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:31.289122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:31.289824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:31.296272 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.296754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.297293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.298017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.298473 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.298865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.325120 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e7e682bc-7b6e-4359-a875-dfdf5efc4cfc tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/ips" status: 200 len: 151 microversion: 2.20 time: 0.110881 Aug 30 16:04:31.325953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 316/641] 10.222.0.20 () {60 vars in 1289 bytes} [Tue Aug 30 16:04:31 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/ips => generated 151 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:04:31.440041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:31.441311 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:31.447978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.448690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.449338 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.450251 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.450878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.451474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.696859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:31.706535 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-55d6ae4a-37ad-4019-b8b7-e8cb6dbf515c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1558 microversion: 2.1 time: 0.270245 Aug 30 16:04:31.707131 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 326/642] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:04:31 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1558 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:04:31.727282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:31.727966 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:31.736255 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.736748 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.737190 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.737907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:31.738355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:31.738850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:31.878852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cdc39523-926f-420d-9176-286aea5b21fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.155763 Aug 30 16:04:31.879446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 317/643] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:04:31 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-interface => generated 285 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:33.163713 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e747b6a0-ed18-483d-b324-4d6c97b82b54 req-4c57862b-4767-4c30-84ff-2f6dfd298039 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "360d09f7-80fb-4478-959b-aac5113ef49f", "tag": "02b08cac-c391-4e35-90bb-f9f633db4707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:33.180404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e747b6a0-ed18-483d-b324-4d6c97b82b54 req-4c57862b-4767-4c30-84ff-2f6dfd298039 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.180877 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e747b6a0-ed18-483d-b324-4d6c97b82b54 req-4c57862b-4767-4c30-84ff-2f6dfd298039 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.181493 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e747b6a0-ed18-483d-b324-4d6c97b82b54 req-4c57862b-4767-4c30-84ff-2f6dfd298039 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.194399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e747b6a0-ed18-483d-b324-4d6c97b82b54 req-4c57862b-4767-4c30-84ff-2f6dfd298039 service nova] Creating event network-changed:02b08cac-c391-4e35-90bb-f9f633db4707 for instance 360d09f7-80fb-4478-959b-aac5113ef49f on hv-cinder-85505 Aug 30 16:04:33.208094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e747b6a0-ed18-483d-b324-4d6c97b82b54 req-4c57862b-4767-4c30-84ff-2f6dfd298039 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048243 Aug 30 16:04:33.208732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 327/644] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:33.826500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:33.827105 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:33.834601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.835204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.835733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.836647 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:33.837199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:33.837737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:33.862328 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lazy-loading 'flavor' on Instance uuid 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:04:34.061664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b4032c9b-9e22-424e-b68b-7702d7436ffb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/action" status: 202 len: 0 microversion: 2.20 time: 0.239633 Aug 30 16:04:34.065370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 318/645] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 30 16:04:33 2022] POST /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/action => generated 0 bytes in 241 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:04:34.071963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:34.072883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:34.080638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:34.081415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:34.082021 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:34.082950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:34.083552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:34.084699 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:34.245782 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:34.256963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:34.258672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:34.259979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ee5f13f-6104-4aaf-851d-867e930e6ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.192870 Aug 30 16:04:34.260814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 328/646] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:34 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:35.288129 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:35.288877 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:35.291186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=79,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:35.297837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.298402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.298946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.299781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:35.300312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:35.300807 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:35.443042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.451549 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.452982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:35.454173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c1d48abf-3e6c-490f-9693-c29406acdd15 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.173740 Aug 30 16:04:35.454751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 319/647] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:35 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:36.477680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:36.478247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:36.484859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.485325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.485754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.486416 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:36.486863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:36.487301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:36.626881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:36.635469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:36.636887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:36.638128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-78a42bbf-478d-4a5e-8989-8ed2451d41b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.164918 Aug 30 16:04:36.638656 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 329/648] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:36 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:37.659952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:37.660621 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:37.667418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.667894 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.668264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.668938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:37.669410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:37.669821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:37.802610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:37.811189 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:37.812907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:37.814203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fac21077-3b44-49b4-98fd-f76db15ef90c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.158198 Aug 30 16:04:37.814832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 320/649] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:37 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:38.837777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:38.838411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:38.845255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.845765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.846197 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.846879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:38.847327 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:38.848060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:38.850928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:39.022210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:39.031629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:39.033190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:39.034455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2cd6fc03-6623-416e-b4da-d5b67087904c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.200763 Aug 30 16:04:39.035153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 330/650] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:38 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:40.058312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:40.058847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:40.065347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:40.065829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:40.066267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:40.066960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:40.067443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:40.067868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:40.205443 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:40.207710 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:40.214954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:40.216392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:40.217583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cf87fe52-f8f5-4c6a-b508-d915ba8b3f0b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.163260 Aug 30 16:04:40.218136 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 321/651] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:40 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:41.241528 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:41.242143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:41.249020 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.249540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.249967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.250659 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:41.251148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:41.251593 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:41.390370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:41.398675 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:41.400217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:41.401413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-01f83de8-5065-4342-b72d-f354f9f4eaa5 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.163934 Aug 30 16:04:41.401968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 331/652] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:41 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:42.424412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:42.424946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:42.432236 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.432733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.433167 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.434098 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:42.434629 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:42.435144 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:42.570532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:42.581797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:42.584578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:42.586824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef6e2236-808d-4602-8ca7-3a7c50bcdffd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.167035 Aug 30 16:04:42.587847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 322/653] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:42 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:43.612613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:43.613249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:43.619826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:43.620301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:43.620729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:43.621421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:43.621862 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:43.622273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:43.821910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:43.830212 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:43.832100 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:43.833281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a088c351-a194-44a6-8bf7-5a11c996cb66 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.225063 Aug 30 16:04:43.833822 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 332/654] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:43 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:44.855919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:44.856698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:44.864017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.864578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.865113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:44.866048 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:44.866568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:44.866994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:45.002916 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:45.011478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:45.012821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:45.014080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8c03a566-7030-4df8-9308-1814be70d4b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.162082 Aug 30 16:04:45.014558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 323/655] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:44 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:46.036399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:46.037064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:46.043914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.044471 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.044979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.045753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:46.046287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:46.046934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:46.181712 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:46.190281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:46.191799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:46.193059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8b74b232-b08b-43d3-a2f3-1a7ae390a420 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.160939 Aug 30 16:04:46.193859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 333/656] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:46 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:47.219894 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:47.222120 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:47.233662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.234508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.235004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.236098 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:47.236822 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:47.237559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:47.380031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:47.388540 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:47.390163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:47.391906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-145827e4-30ce-422f-8233-057c27a09866 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.179411 Aug 30 16:04:47.392594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 324/657] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:47 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:48.419254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:48.420253 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:48.423941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:04:48.432378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.432853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.433306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.433982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:48.434426 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:48.434850 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:48.572404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:48.581402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:48.582814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:48.583966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8cd341d3-5573-41d2-b9ca-f35a3bf1468e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.171508 Aug 30 16:04:48.584514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 334/658] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:48 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:49.611893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:49.612747 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:49.624085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:49.624900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:49.625679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:49.626838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:49.627642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:49.628407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:49.765036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:49.775301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:49.777359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:49.779122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9b804af2-58c6-4c3b-bcb3-7b5ce5c7c5b1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.174313 Aug 30 16:04:49.779844 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 325/659] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:49 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:50.802465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:50.803058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:50.810044 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.810546 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.810962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.811669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:50.812110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:50.812514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:50.957197 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:50.966974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:50.968401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:50.969586 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-13fcbb45-4e0a-40e1-95a9-2be6a45f97a3 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.171095 Aug 30 16:04:50.970144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 335/660] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:50 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:51.997494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:51.998159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:52.008641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:52.009462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:52.010282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:52.011016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:52.011467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:52.011891 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:52.147254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:52.155682 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:52.157138 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:52.158296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c08b774-d936-4f31-b296-a50f1a1aab98 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.166545 Aug 30 16:04:52.158849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 326/661] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:51 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:53.183917 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:53.184656 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:53.193930 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:53.194574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:53.195136 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:53.196046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:53.196638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:53.197190 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:53.332746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:53.341455 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:53.342873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:53.344032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9f2aa274-1131-495d-b565-02983fcd015e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.165477 Aug 30 16:04:53.344787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 336/662] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:53 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:54.367716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:54.368308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:54.375369 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.375859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.376290 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.377451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:54.377907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:54.378324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:54.518568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:54.527885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:54.529649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:54.531007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-94eca723-60cd-4665-8902-432f16bd916a tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.167267 Aug 30 16:04:54.531653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 327/663] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:54 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:55.554303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:55.555154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:55.561805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.562292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.562724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.563704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:55.563829 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:55.564432 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:55.700163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:55.708610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:55.710072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:55.711235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-055cbee3-d65d-4ec7-82fb-03cd1a78f35d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1744 microversion: 2.20 time: 0.160947 Aug 30 16:04:55.711767 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 337/664] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:55 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:04:56.734958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:56.735551 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:56.742162 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.742638 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.743062 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.743836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:56.744165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:56.744918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:56.876053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:56.884557 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:56.886495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:56.887954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-99ee75e2-f6f4-4007-9d9f-f271a3b78ec1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1744 microversion: 2.20 time: 0.157305 Aug 30 16:04:56.888556 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 328/665] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:56 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1744 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:57.911803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:57.912572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:57.920176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.920889 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.921503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:57.922344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:57.922933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:57.923491 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:58.096407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.105543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.107995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:58.109458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-91389477-0eb3-4377-a73c-4fe9feb50bf0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.202197 Aug 30 16:04:58.110439 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 338/666] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:57 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:04:59.136826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:04:59.138498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:04:59.151278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.152635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.154072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.158383 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.159155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.161881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.284939 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-ffb57270-4950-40bb-b912-aeebbe8c244d req-e559f822-f368-497c-8f47-1167931a9cb3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "name": "network-vif-plugged", "status": "completed", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:04:59.295386 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ffb57270-4950-40bb-b912-aeebbe8c244d req-e559f822-f368-497c-8f47-1167931a9cb3 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:04:59.296299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ffb57270-4950-40bb-b912-aeebbe8c244d req-e559f822-f368-497c-8f47-1167931a9cb3 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:04:59.296997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-ffb57270-4950-40bb-b912-aeebbe8c244d req-e559f822-f368-497c-8f47-1167931a9cb3 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:04:59.316733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-ffb57270-4950-40bb-b912-aeebbe8c244d req-e559f822-f368-497c-8f47-1167931a9cb3 service nova] Creating event network-vif-plugged:d0d1588a-51b6-424d-ad20-5fcdc6d3f397 for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 on hv-cinder-85505 Aug 30 16:04:59.325206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-ffb57270-4950-40bb-b912-aeebbe8c244d req-e559f822-f368-497c-8f47-1167931a9cb3 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.238942 Aug 30 16:04:59.326138 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 329/667] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:04:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:04:59.365969 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.399352 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.400967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:04:59.402229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-136d4a22-7750-43fe-b6ee-230967214186 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.270716 Aug 30 16:04:59.404697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 339/668] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:04:59 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:05:00.432206 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:00.432934 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:00.440110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:00.440605 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:00.441036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:00.441760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:00.442238 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:00.442666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:00.594114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:00.603416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:00.605347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:00.606775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef8f45c6-09bc-4f53-9300-5c6049011966 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.179990 Aug 30 16:05:00.613768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 330/669] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:00 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:01.631601 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:01.632175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:01.638303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.639118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.639765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.640730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:01.641434 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:01.642078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:01.897391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:01.911463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:01.913078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:01.914291 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68657f5c-dc0b-44fb-b39d-ab9847fc3318 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.287350 Aug 30 16:05:01.914856 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 340/670] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:01 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:02.944014 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:02.944690 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:02.957848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:02.957848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:02.957848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:02.957848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:02.958352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:02.958352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.110195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:03.120170 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:03.122190 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:03.123412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f31a3dd6-cd2e-4cab-84b1-8c2f07a8d48c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.185172 Aug 30 16:05:03.124272 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 331/671] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:02 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:03.424672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:03.426016 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:03.436521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.437014 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.437643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.439133 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.439750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.440312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.466253 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lazy-loading 'flavor' on Instance uuid e9ad95d7-a73d-4474-acad-c17b7cfd1b09 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:03.572269 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-66cf4102-e08d-4b91-997e-26e73f00f386 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "POST /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09/action" status: 202 len: 0 microversion: 2.1 time: 0.151804 Aug 30 16:05:03.572911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 341/672] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:03 2022] POST /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09/action => generated 0 bytes in 153 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:03.581194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:03.581815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:03.590338 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.592658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.594243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.594974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:03.595442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:03.595865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:03.765561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:03.776612 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ead7d916-f0f4-455c-a58d-a8f93898e218 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.199137 Aug 30 16:05:03.777240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 332/673] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:03 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:04.149089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:04.150143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:04.157249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.158002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.158444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.159129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.159781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.160351 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.315381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:04.324124 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:04.325658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:04.327610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9e5acd19-0fb2-43d4-ab5a-01270c31c8fd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.184481 Aug 30 16:05:04.328186 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 342/674] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:04 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:04.798718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:04.799577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:04.809455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.810040 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.811789 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.812575 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:04.816901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:04.817809 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:04.983881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:04.996372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5e487ff9-3026-4931-b5b5-bedc8264acbf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.201361 Aug 30 16:05:04.997028 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 333/675] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:04 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:05.351613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:05.352211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:05.360914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.360914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.360914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.366200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:05.366803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:05.367360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:05.524346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:05.533487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:05.535091 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:05.536381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d34dc05-6fce-4b88-b6c4-3ce3f4307580 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.189207 Aug 30 16:05:05.552411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 343/676] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:05 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:06.017417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.018059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:06.020459 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=30 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:06.026538 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.027030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.027448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.028222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.028674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.029072 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.203384 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.216726 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e759b740-75cc-47e7-87dc-eef1dfa10b6d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.203142 Aug 30 16:05:06.219570 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 334/677] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:06.559997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:06.561353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:06.568202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.568770 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.569261 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.570003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:06.570640 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:06.571233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:06.717916 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.720390 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:06.728515 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.729895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:06.731039 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c49c57a5-0793-4d83-b81a-4556277f37ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1739 microversion: 2.20 time: 0.175117 Aug 30 16:05:06.731814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 344/678] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:06 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1739 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:07.245414 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:07.246328 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:07.253577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.254060 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.254486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.255178 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.255626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.256016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.388247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.396154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9d626dd9-05b7-49e5-b385-d5a0c32e5f27 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.157274 Aug 30 16:05:07.396749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 335/679] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:07 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:07.754427 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:07.755287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:07.762175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.762991 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.763777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.765141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:07.765745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:07.766323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:07.945571 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.953930 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.955381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:07.956582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6fc53524-384f-4175-bb2b-acafc96e818d tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1721 microversion: 2.20 time: 0.206532 Aug 30 16:05:07.957144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 345/680] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:07 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1721 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:08.418912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.420114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:08.426581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.427092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.427519 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.428209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:08.428657 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:08.429070 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:08.563761 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:08.571453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3be270f9-54bf-4153-be2f-2812900fdf15 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.157267 Aug 30 16:05:08.572023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 336/681] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:08.988199 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:08.989166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:08.999882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.000724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.001503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.002638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.003386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.004083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.147655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.159879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.161428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.163201 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-780a54c2-9cb5-44c3-9368-405cdc0d3091 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1721 microversion: 2.20 time: 0.181889 Aug 30 16:05:09.163988 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 346/682] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:08 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:09.367186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:09.367856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:09.375759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.376238 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.376673 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.377407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.377851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.378269 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.402068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ef19ea48-61ef-47d8-8bf6-99432d0896aa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/ips" status: 200 len: 149 microversion: 2.1 time: 0.041652 Aug 30 16:05:09.402601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 337/683] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:05:09 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:09.594334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:09.595477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:09.603008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.603804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.604482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.605423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:09.605936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:09.606468 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:09.781880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:09.790886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85a6192b-f148-4d54-aa20-a6b409c48d3a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.201962 Aug 30 16:05:09.791454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 347/684] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:09 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:10.186463 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:10.187131 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:10.193924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.194413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.194827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.195534 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.196007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.196404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.335058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:10.344637 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:10.346505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:10.347832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00951128-dd76-442e-bdff-0acd68e47db9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1721 microversion: 2.20 time: 0.165432 Aug 30 16:05:10.348383 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 338/685] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:10 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1721 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:10.764790 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "77d571b5-ffde-4cd9-a42a-ce0c1e903b5b"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:10.767260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:10.775022 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.775742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.776366 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.777074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.777776 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.778315 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.812213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:10.812816 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:10.819150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.819621 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.820066 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.820747 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:10.821198 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:10.821648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:10.840005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=100 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:10.969438 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:10.977808 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-92611e30-2544-4e71-99b2-902d9d8b7ca4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.169545 Aug 30 16:05:10.978941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 339/686] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:10 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:11.111681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3b10db9e-a5f9-420d-b2d4-3ff1eeb4db71 req-5a48fcf4-a138-4932-897e-523d254dc0a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "name": "network-vif-unplugged", "status": "completed", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:11.122608 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3b10db9e-a5f9-420d-b2d4-3ff1eeb4db71 req-5a48fcf4-a138-4932-897e-523d254dc0a5 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.123601 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3b10db9e-a5f9-420d-b2d4-3ff1eeb4db71 req-5a48fcf4-a138-4932-897e-523d254dc0a5 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.124059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3b10db9e-a5f9-420d-b2d4-3ff1eeb4db71 req-5a48fcf4-a138-4932-897e-523d254dc0a5 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.138492 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_external_events [req-3b10db9e-a5f9-420d-b2d4-3ff1eeb4db71 req-5a48fcf4-a138-4932-897e-523d254dc0a5 service nova] Unable to find a host for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8. Dropping event network-vif-unplugged {{(pid=120697) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 16:05:11.139444 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3b10db9e-a5f9-420d-b2d4-3ff1eeb4db71 req-5a48fcf4-a138-4932-897e-523d254dc0a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.032585 Aug 30 16:05:11.140117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 340/687] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:11 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 34 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 16:05:11.141072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6a69f418-28c9-4970-95b9-ff27e2e0bf13 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "POST /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.380033 Aug 30 16:05:11.141878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 348/688] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:05:10 2022] POST /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments => generated 194 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:11.371042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:11.371627 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:11.378221 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.378731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.379172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.379864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.380316 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.380734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.515278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:11.527321 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:11.529302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:11.530941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fcd714db-1121-4ee4-9540-f1bb27de7e00 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1664 microversion: 2.20 time: 0.163849 Aug 30 16:05:11.531510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 341/689] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:11 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1664 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:11.554387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5598fc3b-6a74-403c-b2ca-bd9836d9ff11"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:11.556847 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:11.563003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.563470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.563900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.564549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:11.564987 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:11.565422 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:11.876484 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1693493b-aecb-411f-8e74-0ce1a383215b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.327219 Aug 30 16:05:11.877296 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 349/690] 10.222.0.20 () {62 vars in 1364 bytes} [Tue Aug 30 16:05:11 2022] POST /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-volume_attachments => generated 188 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 30 16:05:11.997552 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:11.998042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.004707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.004857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:12.005195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.005649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.006141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.006342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.006793 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.007210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.012386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.012865 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.013321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.014003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.014448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.014933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.151288 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.159340 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-086c4d95-0d2e-44ac-ad18-b089087ff4df tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.158443 Aug 30 16:05:12.159960 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 350/691] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:11 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:12.281153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c07cc0f2-7032-47cf-be5b-9b1116a153b6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-volume_attachments/5598fc3b-6a74-403c-b2ca-bd9836d9ff11" status: 202 len: 0 microversion: 2.20 time: 0.287641 Aug 30 16:05:12.281787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 342/692] 10.222.0.20 () {60 vars in 1457 bytes} [Tue Aug 30 16:05:11 2022] DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-volume_attachments/5598fc3b-6a74-403c-b2ca-bd9836d9ff11 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:05:12.339424 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:12.340004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.346901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.347389 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.347814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.348508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.348952 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.349412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.383687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120696) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 16:05:12.455987 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-640afc6d-34e7-4d4e-8fce-2579b1f6f302 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "POST /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/action" status: 202 len: 0 microversion: 2.20 time: 0.120445 Aug 30 16:05:12.457110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 351/693] 10.222.0.20 () {62 vars in 1319 bytes} [Tue Aug 30 16:05:12 2022] POST /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:05:12.465518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:12.466752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:12.473414 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.473913 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.474509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.475228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:12.475849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:12.476264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:12.619080 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.627533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.633017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:12.633017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5cc3ce4d-6581-4ef3-881d-a71d332b344c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1672 microversion: 2.20 time: 0.168988 Aug 30 16:05:12.633017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 343/694] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:12 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1672 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:05:13.180698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:13.181346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:13.188344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.188963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.189428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.190120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.190561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.191139 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.379763 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:13.387539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-62617396-dd53-4e75-810a-3b798cb17018 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.211211 Aug 30 16:05:13.388109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 352/695] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:13 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:13.653185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:13.653918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:13.661979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.662562 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.663083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.663827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:13.665068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:13.665683 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:13.831083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:13.840569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:13.842274 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:13.843606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a5e29b4-05d8-453d-8fae-d0e393eac76b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1672 microversion: 2.20 time: 0.195576 Aug 30 16:05:13.844378 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 344/696] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:13 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1672 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:05:14.412469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:14.412469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:14.415282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.415765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.416192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.416874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.417355 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.417745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.556830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:14.566067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-41ebb47a-4dc2-4dc8-b586-27a95916c62a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.161842 Aug 30 16:05:14.566539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 353/697] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:14 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:14.869602 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:14.870309 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:14.877036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.877631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.878469 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:14.879171 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:14.879599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:14.880292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:15.097543 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:15.107588 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:15.109451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:15.110731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bdc1b6f-9a98-4bda-aef2-40c85894c6f6 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.247022 Aug 30 16:05:15.111616 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 345/698] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:14 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:15.587962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:15.588444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:15.597056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:15.598261 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:15.598777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:15.599489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:15.600066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:15.600415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:15.751075 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:15.759225 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8d0ec4a0-6d14-45a2-ba19-bf2ffb901d16 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.175905 Aug 30 16:05:15.759800 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 354/699] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:15 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:16.139159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:16.140326 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:16.152759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.153680 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.154457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.156086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.156998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.157881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.340527 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:16.350244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:16.351739 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:16.352919 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-603c6934-95ad-4939-ba00-cf82a48d6291 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.219938 Aug 30 16:05:16.353642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 346/700] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:16 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:16.780222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:16.780897 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:16.788174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.788655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.789080 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.789811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:16.790258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:16.790678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:16.946563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:16.955625 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68eae100-154e-44c9-b401-c33dd6425c9f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.179336 Aug 30 16:05:16.956214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 355/701] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:16 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:17.376146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:17.376793 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:17.383600 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.384082 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.388635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.388635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.388635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.388635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.531800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:17.541566 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:17.543000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:17.544165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0e176440-ccd2-4b0f-b1c3-e20b3a3a5433 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.172013 Aug 30 16:05:17.544733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 347/702] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:17 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:17.977751 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:17.978980 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:17.987798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.988539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.989147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:17.990032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:17.990671 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:17.991137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.007707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:18.132372 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:18.141388 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9f04b3eb-ded9-4536-93c6-ce83b35169ad tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.168911 Aug 30 16:05:18.142094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 356/703] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:17 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:18.567349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:18.567932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:18.574554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.575030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.575451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.576148 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:18.576587 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:18.577035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:18.725980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:18.736377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:18.738164 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:18.739721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-61e02fa8-9fd0-48ad-88c3-f9b95d73f651 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.176980 Aug 30 16:05:18.740509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 348/704] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:18 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:19.170578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.171945 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.178223 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:19.179911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.180630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.181330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.182299 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.182942 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.183558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.330407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:19.338645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7a524f71-9623-4f71-b880-1e4ff4abade1 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.171950 Aug 30 16:05:19.339487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 357/705] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:19 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:19.764106 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:19.764717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:19.771907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.772415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.773086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.773827 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:19.774294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:19.774719 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:19.926411 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:19.935529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:19.937380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:19.938777 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ce249b55-4f74-4766-8c1a-46bc3f3819d9 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.178655 Aug 30 16:05:19.939869 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 349/706] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:19 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:20.364026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:20.364772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:20.372107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.372949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.373601 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:20.374509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.375167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.375835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:20.521247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:20.529931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ed3d8ed6-eb77-456b-9c74-6e07023c68b0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.170393 Aug 30 16:05:20.530588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 358/707] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:20 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:20.962994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:20.968156 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:20.976338 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.976825 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.977251 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:20.977978 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:20.978421 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:20.978837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:21.132261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:21.152865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:21.154445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:21.155737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-95dce8c5-f6d6-4cce-a8b1-067dd12d5400 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.197200 Aug 30 16:05:21.156504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 350/708] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:20 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:21.552402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:21.553953 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:21.560766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:21.561266 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:21.561738 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:21.562428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:21.562872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:21.563287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:21.745887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:21.756642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-65ec7a1a-d59b-45a9-93a1-cfeed515a89f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.208036 Aug 30 16:05:21.757270 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 359/709] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:21 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:22.179745 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:22.180412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:22.187403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:22.187890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:22.188318 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:22.188999 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:22.189481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:22.189897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:22.341955 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:22.350174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:22.351609 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:22.352906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3dbbaed4-ea67-492e-9feb-4c9f137ffc11 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.177220 Aug 30 16:05:22.353508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 351/710] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:22 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:22.779014 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:22.779687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:22.786578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:22.787062 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:22.787475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:22.788206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:22.788657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:22.789083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:22.964263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:22.972825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-843f27be-1583-45b1-9f8a-0a3fc5adbd3c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.197674 Aug 30 16:05:22.973832 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 360/711] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:22 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:23.378527 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:23.379760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:23.387861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:23.388321 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:23.388758 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:23.389552 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:23.390074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:23.393393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:23.545401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:23.554896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:23.556327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:23.557525 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58093d8b-5308-4cd2-944f-16e5d409f535 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.183152 Aug 30 16:05:23.558160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 352/712] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:23 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:23.994716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:23.997239 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:24.004288 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:24.005031 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:24.005521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:24.006336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:24.006806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:24.007255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:24.187971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:24.196105 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-46a72b41-c4e2-4c3f-ad90-1a7dc953603d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.205413 Aug 30 16:05:24.196677 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 361/713] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:23 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:24.581529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:24.582176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:24.589026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:24.589541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:24.589979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:24.590661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:24.591108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:24.591528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:24.736688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:24.748666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:24.750870 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:24.752646 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cb82fa26-797c-4224-94d3-7c2606af1a21 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.175302 Aug 30 16:05:24.753445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 353/714] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:24 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:25.218429 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:25.219543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:25.228942 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.229721 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.230356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.231359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.232572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.233004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.374195 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:25.382630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0becfc91-1d14-4a84-891c-1e58043fc976 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.168555 Aug 30 16:05:25.383198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 362/715] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:25 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:25.783221 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:25.784465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:25.791358 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.791840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.792267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.792958 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:25.793453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:25.793871 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:25.797861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:25.927075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:25.935382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:25.936822 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:25.938019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3970795b-dd87-4a99-8e09-d3d71c1206e0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.161419 Aug 30 16:05:25.938590 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 354/716] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:25 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:26.404153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:26.404711 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:26.411585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:26.412071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:26.412500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:26.413185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:26.413694 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:26.414111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:26.554308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:26.562622 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8633afdc-2e4e-4613-a472-5938b0bfba17 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.162420 Aug 30 16:05:26.563197 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 363/717] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:26 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:26.968427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:26.969678 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:26.979888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:26.980381 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:26.980813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:26.981574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:26.982354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:26.982774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.120376 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:27.131578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:27.133015 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:27.134212 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01f47875-0739-440f-98b5-31a4794cf40b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.175487 Aug 30 16:05:27.134787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 355/718] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:26 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:27.419726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:27.420250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:27.429723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:27.430344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:27.430969 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.432163 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:27.432735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:27.433321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.518584 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'services' on Instance uuid 360d09f7-80fb-4478-959b-aac5113ef49f {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:27.584440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:27.585069 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:27.591265 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:27.591741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:27.592160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.592326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-95ebdf22-cb8d-4bfc-adbd-ec465c2edfc0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments/77d571b5-ffde-4cd9-a42a-ce0c1e903b5b" status: 202 len: 0 microversion: 2.1 time: 0.178676 Aug 30 16:05:27.592839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:27.596045 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 364/719] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:05:27 2022] DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments/77d571b5-ffde-4cd9-a42a-ce0c1e903b5b => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:27.596172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:27.596172 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.601627 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:27.603954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:27.610696 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:27.611182 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:27.611610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.612305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:27.612751 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:27.613236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:27.643541 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-41bc43df-576c-4856-b08c-0dadb1302535 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046009 Aug 30 16:05:27.644306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 365/720] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:05:27 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:27.723686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:27.731649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7c22224-bb7d-449d-9fb8-080771a33243 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.151698 Aug 30 16:05:27.732531 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 356/721] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:27 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:28.158437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:28.159136 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:28.165971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.166451 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.166874 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.167551 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.167993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.168405 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.345457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:28.353883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:28.355314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:28.356479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4e3d8121-c58a-4e2c-bf6e-567903a761fe tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.202739 Aug 30 16:05:28.357422 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 366/722] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:28 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:28.659402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:28.661935 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:28.668831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.669493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.669933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.670698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.671150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.671571 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.702239 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7c4afed3-61d2-4e61-8564-f6654c3ccc3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048808 Aug 30 16:05:28.702800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 357/723] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:05:28 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:28.753231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:28.753870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:28.760808 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.761291 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.761731 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.762409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:28.762854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:28.763280 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:28.923024 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:28.932641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-84db975d-3483-464d-8040-8844fd6a7931 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.183280 Aug 30 16:05:28.933251 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 367/724] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:28 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:29.380403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:29.381110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:29.387355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.387913 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.388441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.389111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.389604 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.390015 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.583244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:29.592391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:29.594493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:29.595681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b0d04bf1-93e6-4cfb-a14e-e564c3951add tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.220005 Aug 30 16:05:29.605294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 358/725] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:29 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:29.715236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:29.718274 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:29.724804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.725774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.726232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.727416 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.728017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.728948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.760462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f2d64ff1-9a3b-4850-b710-bc4602803c80 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049498 Aug 30 16:05:29.761116 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 368/726] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:05:29 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:05:29.829659 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:29.831114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:29.838193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.838757 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.839212 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.839953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.840452 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.840873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.866548 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:05:29.953150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a9f37fd0-3d52-45a3-a7c5-605cb6956971 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 204 len: 0 microversion: 2.1 time: 0.128739 Aug 30 16:05:29.953763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 359/727] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:29 2022] DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:05:29.953943 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:29.954529 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:29.960843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.961438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.961865 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.962413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:29.962588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.962993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.963137 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:29.963408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.968926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.969440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.969861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:29.970546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:29.970992 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:29.971410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.164926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.173578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-00828f2b-b5ec-47df-b78b-dbbdc2caf2fa tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1568 microversion: 2.1 time: 0.223461 Aug 30 16:05:30.174176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 369/728] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:29 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1568 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:30.181968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.190595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-67367964-7c52-4dbd-b051-8b321bc3eaa0 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1681 microversion: 2.1 time: 0.231838 Aug 30 16:05:30.191282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 360/729] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:29 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1681 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:30.195587 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:30.196332 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:30.202500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.202964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.203407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.204086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.204525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.204941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.234010 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120696) unshelve /opt/stack/nova/nova/compute/api.py:4591}} Aug 30 16:05:30.314895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3fec418c-7f37-4133-b4a3-0c35a7373264 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "POST /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09/action" status: 202 len: 0 microversion: 2.1 time: 0.123428 Aug 30 16:05:30.315804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 370/730] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:05:30 2022] POST /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:30.324456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:30.325138 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:30.331323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.331784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.332249 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.332904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.333423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.333834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.501065 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.509446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cc1f9918-4b94-45a8-8572-b4298e2dfe0e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1576 microversion: 2.1 time: 0.189016 Aug 30 16:05:30.510258 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 361/731] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:30 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1576 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:30.620259 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:30.620871 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:30.627961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.628419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.629081 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.629808 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:30.630263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:30.630799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:30.647540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:30.784779 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.795323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.796951 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:30.798167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-eecc8122-66ef-4112-b7e5-91e1998fe7b7 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.181910 Aug 30 16:05:30.798738 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 371/732] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:30 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 30 16:05:31.212699 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:31.213392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:31.221923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.222635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.223311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.224241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.224942 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.225394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.241192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e6eda693-d202-4532-9dbc-67bd7d6c0b86 req-c348e40a-6f93-4a83-92b7-f3f2730cf788 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "name": "network-vif-plugged", "status": "completed", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:31.250734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e6eda693-d202-4532-9dbc-67bd7d6c0b86 req-c348e40a-6f93-4a83-92b7-f3f2730cf788 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.251688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e6eda693-d202-4532-9dbc-67bd7d6c0b86 req-c348e40a-6f93-4a83-92b7-f3f2730cf788 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.252227 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e6eda693-d202-4532-9dbc-67bd7d6c0b86 req-c348e40a-6f93-4a83-92b7-f3f2730cf788 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.267687 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e6eda693-d202-4532-9dbc-67bd7d6c0b86 req-c348e40a-6f93-4a83-92b7-f3f2730cf788 service nova] Creating event network-vif-plugged:d0d1588a-51b6-424d-ad20-5fcdc6d3f397 for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 on hv-cinder-85505 Aug 30 16:05:31.273356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e6eda693-d202-4532-9dbc-67bd7d6c0b86 req-c348e40a-6f93-4a83-92b7-f3f2730cf788 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038333 Aug 30 16:05:31.273967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 372/733] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:31.369666 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.377751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-68c17de0-6a8f-42fc-9eec-c38225f552cc tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1681 microversion: 2.1 time: 0.169865 Aug 30 16:05:31.378322 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 362/734] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:31 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:31.531387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:31.532077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:31.538919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.539404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.539827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.540533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.540983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.541409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.685846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.696333 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85fe1352-d024-4201-b101-42cb1b1c64de tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1576 microversion: 2.1 time: 0.169289 Aug 30 16:05:31.697884 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 373/735] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:31 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:31.821945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:31.822518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:31.833617 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.834110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.834546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.835254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:31.835706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:31.836127 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:31.969564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.977980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.979404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:31.980529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a78b54c-a126-4352-9602-ea533deb743b tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.162550 Aug 30 16:05:31.981086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 363/736] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:31 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:32.401578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:32.402513 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:32.410000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.410736 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.411381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:32.412250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.412901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.413489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:32.600714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:32.609901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a587472a-0b28-4bd2-b596-3d6e429a7c1f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1681 microversion: 2.1 time: 0.213040 Aug 30 16:05:32.623353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 374/737] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:32 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1681 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:32.718340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:32.719573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:32.726152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.726832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.727445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:32.728294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:32.729152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:32.729741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.004774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.006490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:33.015078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.015570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.016162 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.016832 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.017621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.018235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.210821 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.223468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9997425d-5265-465d-903b-5777ecaf985b tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1518 microversion: 2.1 time: 0.508519 Aug 30 16:05:33.224895 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 364/738] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:32 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1518 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:33.296174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.305308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.311238 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-fdc720d1-eea8-4af8-9013-2aa8d56e901b req-e7ab5df9-db17-4c04-8e5a-6bd32d81a9bb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "name": "network-vif-unplugged", "status": "completed", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:33.324592 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.326971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7ae30376-3576-4cb1-ad18-f6db6ec18bfd tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1730 microversion: 2.20 time: 0.326583 Aug 30 16:05:33.327113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdc720d1-eea8-4af8-9013-2aa8d56e901b req-e7ab5df9-db17-4c04-8e5a-6bd32d81a9bb service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.327977 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdc720d1-eea8-4af8-9013-2aa8d56e901b req-e7ab5df9-db17-4c04-8e5a-6bd32d81a9bb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.328662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-fdc720d1-eea8-4af8-9013-2aa8d56e901b req-e7ab5df9-db17-4c04-8e5a-6bd32d81a9bb service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.331037 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 375/739] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:32 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1730 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:33.375267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.compute.server_external_events [req-fdc720d1-eea8-4af8-9013-2aa8d56e901b req-e7ab5df9-db17-4c04-8e5a-6bd32d81a9bb service nova] Unable to find a host for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09. Dropping event network-vif-unplugged {{(pid=120697) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Aug 30 16:05:33.376037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-fdc720d1-eea8-4af8-9013-2aa8d56e901b req-e7ab5df9-db17-4c04-8e5a-6bd32d81a9bb service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.068669 Aug 30 16:05:33.384349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 365/740] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 71 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Aug 30 16:05:33.592603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6f75e7c0-249c-4823-adfe-a7af56f4fdd9 req-02aa84a9-00b7-435b-b8bd-7d41c21f2547 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "360d09f7-80fb-4478-959b-aac5113ef49f", "name": "network-vif-deleted", "tag": "02b08cac-c391-4e35-90bb-f9f633db4707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:33.611811 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6f75e7c0-249c-4823-adfe-a7af56f4fdd9 req-02aa84a9-00b7-435b-b8bd-7d41c21f2547 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.612707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6f75e7c0-249c-4823-adfe-a7af56f4fdd9 req-02aa84a9-00b7-435b-b8bd-7d41c21f2547 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.613806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6f75e7c0-249c-4823-adfe-a7af56f4fdd9 req-02aa84a9-00b7-435b-b8bd-7d41c21f2547 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.638841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:33.640053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:33.662478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.663723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.664638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6f75e7c0-249c-4823-adfe-a7af56f4fdd9 req-02aa84a9-00b7-435b-b8bd-7d41c21f2547 service nova] Creating event network-vif-deleted:02b08cac-c391-4e35-90bb-f9f633db4707 for instance 360d09f7-80fb-4478-959b-aac5113ef49f on hv-cinder-85505 Aug 30 16:05:33.665054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.667715 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:33.668015 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:33.669001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:33.680632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6f75e7c0-249c-4823-adfe-a7af56f4fdd9 req-02aa84a9-00b7-435b-b8bd-7d41c21f2547 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297137 Aug 30 16:05:33.686889 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 376/741] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:33.794965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:33.804041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e55b4989-7837-4ffb-9b4b-e5f9e6d411bd tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1326 microversion: 2.1 time: 0.176779 Aug 30 16:05:33.804638 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 366/742] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:33 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1326 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:34.247441 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:34.248678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:34.255325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.255807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.256243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.256915 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.257402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.257820 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.353307 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:34.353909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:34.360617 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.361335 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.361872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.362684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.363239 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.363770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.416055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:34.424714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e79cd1e8-355a-4ac8-aae1-6b8960ca9ec0 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.181685 Aug 30 16:05:34.425755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 377/743] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:34 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:34.500536 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:34.509151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:34.510739 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:34.511914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c23c14f-c4c9-48db-a72e-2ead0b21d715 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1717 microversion: 2.20 time: 0.162609 Aug 30 16:05:34.512475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 367/744] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:05:34 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1717 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:05:34.827467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:34.828036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:34.834545 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.835026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.835456 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.836148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.836598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.837013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.869308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:34.869821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:34.870233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:34.870668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid 360d09f7-80fb-4478-959b-aac5113ef49f {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:34.911006 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:34.919159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3493efd0-4883-4baf-bfae-c00160d04c3f tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1331 microversion: 2.1 time: 0.095857 Aug 30 16:05:34.919717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 378/745] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:34 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:35.450520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:35.451528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:35.461743 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:35.462539 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:35.463254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:35.464380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:35.465123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:35.465872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:35.605041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:35.617812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c36ab29-1376-48e1-91e4-b3b91aa24203 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.174045 Aug 30 16:05:35.618712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 368/746] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:35 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:35.939293 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:35.939902 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:35.946885 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:35.947364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:35.947787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:35.948497 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:35.948913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:35.949364 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:35.983101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:35.983570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:35.983997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:35.984433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lazy-loading 'fault' on Instance uuid 360d09f7-80fb-4478-959b-aac5113ef49f {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:05:36.024407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b133ae684f20468f982ae0c25020d837', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2c2aad2014bc4db49a818a6926f860d5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:36.032212 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c38d1925-9a0d-45bf-a320-cd0f161553fa tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 200 len: 1331 microversion: 2.1 time: 0.096808 Aug 30 16:05:36.032764 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 379/747] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:35 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 1331 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:36.643670 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:36.644649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:36.647490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:36.653541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:36.654078 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:36.654510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:36.655247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:36.655665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:36.656288 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:36.798558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:36.803037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:36.807987 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8dccfe77-b95e-4c9f-8caf-991244591dea tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.171023 Aug 30 16:05:36.808679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 369/748] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:36 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:37.054941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:37.055642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:37.063748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.064295 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.064822 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.065617 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.066144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.066776 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.086356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f HTTP/1.1 Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:05:37.088125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:37.089641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '360d09f7-80fb-4478-959b-aac5113ef49f'} Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:37.090417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:37.091691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:37.094137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:37.094963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e3a3e14f-1519-49f6-a680-7752ef14bec3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 404 len: 111 microversion: 2.1 time: 0.045498 Aug 30 16:05:37.095718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 380/749] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:37 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:37.104740 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-617bdf18-f08c-4d8e-8c66-00b93dc55bee tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '.version_select at 0x7f4843e739d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:37.134471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-617bdf18-f08c-4d8e-8c66-00b93dc55bee tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-821494006" status: 202 len: 0 microversion: 2.1 time: 0.033750 Aug 30 16:05:37.135581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 370/750] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 30 16:05:37 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-821494006 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:05:37.828882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:37.829809 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:37.836002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.836515 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.836947 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.837803 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:37.838433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:37.839247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:37.980893 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:37.992039 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-732cc7fd-4590-4711-91fc-da70b02c9cb2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.167031 Aug 30 16:05:37.992603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 381/751] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:37 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:38.911849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:38.912426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:38.920943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.921615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.922157 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.923199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.923843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.924453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.939082 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f HTTP/1.1 Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:05:38.940751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.942446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '360d09f7-80fb-4478-959b-aac5113ef49f'} Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:38.943542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.945095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.946664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:38.946664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-aa78e24b-7ec4-4508-ad15-2a810834f494 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 404 len: 111 microversion: 2.1 time: 0.037603 Aug 30 16:05:38.946664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 371/752] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:38 2022] DELETE /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:38.950922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:38.951560 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 360d09f7-80fb-4478-959b-aac5113ef49f] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:38.958512 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.958996 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.959508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.960199 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:38.960646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:38.961068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:38.974494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f HTTP/1.1 Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:05:38.976002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.977519 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '360d09f7-80fb-4478-959b-aac5113ef49f'} Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:38.978430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. Aug 30 16:05:38.979936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:38.981421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 360d09f7-80fb-4478-959b-aac5113ef49f could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:38.981421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3f2b67f0-bc80-4798-bce4-e6a9888e2fe3 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f" status: 404 len: 111 microversion: 2.1 time: 0.030419 Aug 30 16:05:38.981421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 382/753] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:38 2022] GET /compute/v2.1/servers/360d09f7-80fb-4478-959b-aac5113ef49f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:39.019342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:39.020002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:39.026248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.026730 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.027165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.027847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:39.028292 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:39.028770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:39.172770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:39.184787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c04dfa30-03ae-4033-ae1c-73965020ea46 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.169107 Aug 30 16:05:39.185481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 372/754] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:39 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:40.140029 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.140548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.147660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.148137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.148554 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.149263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.149698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.150109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.164667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 HTTP/1.1 Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:05:40.166217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.167637 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': 'dbff92f4-6c46-464b-93ac-6d56f92d2395'} Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:40.170964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.172516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.174023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:40.174023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-85dd96bf-d496-4cc0-b2a1-3fa9263bcf8c tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 404 len: 111 microversion: 2.1 time: 0.031463 Aug 30 16:05:40.174023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 383/755] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:40 2022] DELETE /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:40.178589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.179202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: dbff92f4-6c46-464b-93ac-6d56f92d2395] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.185923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.186403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.186836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.187523 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.187972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.188391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.201749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 HTTP/1.1 Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:05:40.203287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.205000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': 'dbff92f4-6c46-464b-93ac-6d56f92d2395'} Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:40.206034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. Aug 30 16:05:40.207589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.209135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance dbff92f4-6c46-464b-93ac-6d56f92d2395 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:40.209135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4a83bb5e-605c-4243-bfd4-b2468e3521cf tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395" status: 404 len: 111 microversion: 2.1 time: 0.031625 Aug 30 16:05:40.209135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 373/756] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:40 2022] GET /compute/v2.1/servers/dbff92f4-6c46-464b-93ac-6d56f92d2395 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:40.209511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.209511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.212613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.213105 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.213656 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.214270 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.214702 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.215385 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.215825 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.216241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.218902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.219383 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.219814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.220484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.220933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.221386 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.235237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 HTTP/1.1 Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:05:40.236771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.239163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '096b49e4-be8b-48c6-88a3-19b6a555ff37'} Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:40.240147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.242077 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.243442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:40.243442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2079b68d-aa15-42e8-9148-9e1bfc0f82f5 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 404 len: 111 microversion: 2.1 time: 0.029166 Aug 30 16:05:40.243442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 374/757] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:40 2022] DELETE /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:05:40.246403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:40.247008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 096b49e4-be8b-48c6-88a3-19b6a555ff37] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:40.252923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.253445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.253881 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.254575 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:40.255026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:40.255447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:40.270755 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 HTTP/1.1 Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:05:40.272655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.275734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '096b49e4-be8b-48c6-88a3-19b6a555ff37'} Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:40.276641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. Aug 30 16:05:40.278311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:05:40.279620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 096b49e4-be8b-48c6-88a3-19b6a555ff37 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:40.279620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0a9536ef-52e3-43e4-82ad-15917484ddf8 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37" status: 404 len: 111 microversion: 2.1 time: 0.031208 Aug 30 16:05:40.279620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 375/758] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:40 2022] GET /compute/v2.1/servers/096b49e4-be8b-48c6-88a3-19b6a555ff37 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:05:40.360456 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:40.369979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-44d3b6df-6d27-4ccf-b040-ecd8510fcabf tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.167346 Aug 30 16:05:40.370562 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 384/759] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:40 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:41.394787 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.395417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:41.402687 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.403163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.403593 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.404295 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.404735 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.405146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.423414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.424026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:41.431137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.431638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.432073 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.432779 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.433265 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.433686 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.449405 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 HTTP/1.1 Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:05:41.451000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.452583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '9d200922-337c-4f7b-afc6-6a2c2b2dc9b0'} Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:41.453481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.454653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.455831 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:41.455831 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7dee1515-e5d4-4712-8b37-7a7adfadcdf9 tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 404 len: 111 microversion: 2.1 time: 0.033099 Aug 30 16:05:41.455831 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 385/760] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:05:41 2022] DELETE /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:41.461472 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:41.462089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] [instance: 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:41.468913 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.469442 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.469876 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.470583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:41.471013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:41.471680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:41.487670 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] HTTP exception thrown: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Request method failure captured: Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 HTTP/1.1 Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPW5o_GleydeKQNalTZtX9mO8xkzc0rYa9XNxQeZFoYS3DHve2h0gAEAaJ696k-_veNI6p3r4BbwkTt6u_3b8UoRIS06dT6bGWgnn2q1uY2gkh_Nk7Fpj9U-vy6i5AWzFqt4iKtnIJsM3LhAyIPLWnZqEr_rCj1XUWVP5uN5rhmwlg Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:05:41.489437 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_2c2aad2014bc4db49a818a6926f860d5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 2c2aad2014bc4db49a818a6926f860d5 Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1488210824 Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: b133ae684f20468f982ae0c25020d837 Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeNegativeTest-1488210824-project Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.491041 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '9d200922-337c-4f7b-afc6-6a2c2b2dc9b0'} Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:41.495543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. Aug 30 16:05:41.497517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:41.498869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] Returning 404 to user: Instance 9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:41.498869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-991d5d63-c050-4a16-8ac4-7eaa18e7baed tempest-AttachVolumeNegativeTest-1488210824 tempest-AttachVolumeNegativeTest-1488210824-project] 10.222.0.20 "GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0" status: 404 len: 111 microversion: 2.1 time: 0.033533 Aug 30 16:05:41.498869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 386/761] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:41 2022] GET /compute/v2.1/servers/9d200922-337c-4f7b-afc6-6a2c2b2dc9b0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:41.751330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:41.759148 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c7bace74-638c-4ae3-9ac9-5783b43e9709 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.368420 Aug 30 16:05:41.759724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 376/762] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:41 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:42.780485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:42.781086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:42.788443 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.788961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.789423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:42.790292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:42.790926 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:42.791345 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:43.008436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:43.017550 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-88b93127-c614-44f5-ae35-731064bffd3e tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.240979 Aug 30 16:05:43.018444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 387/763] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:42 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:44.040018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:44.041530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:44.049807 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:44.050515 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:44.051113 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:44.051973 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:44.052580 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:44.053161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:44.228711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:44.237238 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c2329cce-e6d9-4421-9451-af97dc3e404d tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.202484 Aug 30 16:05:44.237994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 377/764] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:44 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:45.259184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:45.259819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:45.269500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.269500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.269937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.271007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:45.271093 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:45.271633 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:45.427698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:45.435837 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-923cdba2-e7ad-4c20-8133-2dc30cfe0922 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.181632 Aug 30 16:05:45.436413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 388/765] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:45 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:45.708034 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1876654132", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "networks": [{"uuid": "f8ed2ccc-9e41-4749-9a9b-f453e44c8e33"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:45.764086 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] validate_networks() for [('f8ed2ccc-9e41-4749-9a9b-f453e44c8e33', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:05:46.286548 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:05:46.286961 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:05:46.287645 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:05:46.288353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:05:46.288758 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:05:46.298140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.298671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.299100 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.299843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.300287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.300716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.318350 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Getting quotas for project ebf5f0daa032440ab81e5abda55f6e82. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:05:46.322754 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Getting quotas for user 08661f6694ff44a0a4d15c792b54bb97 and project ebf5f0daa032440ab81e5abda55f6e82. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:05:46.334020 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:05:46.336424 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:05:46.391550 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-780961a2-68e3-4ffb-8fd4-717ca7de0ab0 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.687440 Aug 30 16:05:46.392794 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 378/766] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:05:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:05:46.404091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-86118a68-a3ae-4da4-b4c7-fe643ebdd8f2 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.404771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-86118a68-a3ae-4da4-b4c7-fe643ebdd8f2 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:46.458299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-86118a68-a3ae-4da4-b4c7-fe643ebdd8f2 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.463503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-15df9919-32d4-4863-a09e-dc824f3e3db5 tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Action: 'create', calling method: .version_select at 0x7f4843f57af0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-440701611", "metadata": {"Type": "work"}}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:46.466476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-86118a68-a3ae-4da4-b4c7-fe643ebdd8f2 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1219 microversion: 2.1 time: 0.066881 Aug 30 16:05:46.467036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 379/767] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:46.471663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.472461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:46.486628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.487355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.487791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.488595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:46.489128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:46.489656 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:46.642892 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:46.651671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6c0fde13-d405-4d15-858e-812a8c4c895c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.183414 Aug 30 16:05:46.652248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 380/768] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:46.813793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-15df9919-32d4-4863-a09e-dc824f3e3db5 tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.503926 Aug 30 16:05:46.814423 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 389/769] 10.222.0.20 () {60 vars in 1156 bytes} [Tue Aug 30 16:05:46 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 506 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 30 16:05:46.828032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b45f65ee-3cd0-43ff-a848-4e17271a2c3d tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Calling method '.version_select at 0x7f4843ebd9d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:46.878554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b45f65ee-3cd0-43ff-a848-4e17271a2c3d tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335" status: 200 len: 352 microversion: 2.1 time: 0.054658 Aug 30 16:05:46.879124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 381/770] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:46 2022] GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:47.492414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.493370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:47.505408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.506091 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.506804 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.507679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.508124 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.508540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.575771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:47.583571 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8dda3808-d989-4576-8c80-cf42b88586ad tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1271 microversion: 2.1 time: 0.098446 Aug 30 16:05:47.584147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 390/771] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:47.672928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.672928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:47.683548 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.684533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.685564 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.686558 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:47.687228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:47.688041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:47.892367 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e66d96d3-b688-4081-a69b-137e72f9311a tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Calling method '.version_select at 0x7f4843f074c0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:47.921389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:47.929794 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7eee29c9-0821-4bde-8601-3e54a863861a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.261575 Aug 30 16:05:47.930599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 382/772] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:47.945008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e66d96d3-b688-4081-a69b-137e72f9311a tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335" status: 200 len: 353 microversion: 2.1 time: 0.056401 Aug 30 16:05:47.945648 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 391/773] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 => generated 353 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:47.958109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58e513bc-62bf-4e4a-a575-5375bce32f2b tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Calling method '.version_select at 0x7f4843ebd9d0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.007798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58e513bc-62bf-4e4a-a575-5375bce32f2b tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335" status: 200 len: 353 microversion: 2.1 time: 0.053457 Aug 30 16:05:48.008432 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 383/774] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:47 2022] GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:48.021689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-47a54038-af2a-44f7-9a3f-d524362c3f49 tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Calling method '.version_select at 0x7f4843f17670>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.085110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-47a54038-af2a-44f7-9a3f-d524362c3f49 tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "DELETE /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335" status: 202 len: 0 microversion: 2.1 time: 0.067281 Aug 30 16:05:48.085734 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 392/775] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:05:48 2022] DELETE /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:05:48.094526 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-951e410c-d74b-4104-b87a-93949ae36e6b tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Calling method '.version_select at 0x7f4843e86f70>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.151993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-951e410c-d74b-4104-b87a-93949ae36e6b tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335" status: 200 len: 352 microversion: 2.1 time: 0.061919 Aug 30 16:05:48.152783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 384/776] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:48 2022] GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 => generated 352 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:48.605950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.606848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:48.613758 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.614243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.614668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.615360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.615809 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.616217 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.824937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:48.833104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-19dd127b-e264-425a-b344-47e78fad50aa tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.231839 Aug 30 16:05:48.833739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 393/777] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:48 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:48.952914 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:48.953656 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:48.960516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.960994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.961454 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:48.962110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:48.962582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:48.962997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.152829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:49.164885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-42b86ae5-e3dc-4646-b8ad-0682bb22ca54 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.216177 Aug 30 16:05:49.165861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 385/778] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:48 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:49.166703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-727dbdaf-983b-4d53-ac0d-7a7bc7be33ce tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Calling method '.version_select at 0x7f4843f075e0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:49.196279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-727dbdaf-983b-4d53-ac0d-7a7bc7be33ce tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] HTTP exception thrown: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-727dbdaf-983b-4d53-ac0d-7a7bc7be33ce tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Request method failure captured: Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 HTTP/1.1 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjVaZcx2bpuQEwySyUq2KB74qm3DQzPgaIM3UdgWzxZvCalBlwXpnQZ8e80eUoPJ9_3M1FN7E7Kwm_IcK3N2Gf_ykUa3b5udWCxSbExpn9EggNHBRSkLJ7HX6tjcIFKK9cLZGGyWx0ObQqUXfvLXtUUDqcRnkepDFIdzN9AVtg8Fzk4 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: e181b24f6b4b41268657cd872cbc2849 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesGetTestJSON-885447229 Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:05:49.198435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e181b24f6b4b41268657cd872cbc2849"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/e181b24f6b4b41268657cd872cbc2849"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/e181b24f6b4b41268657cd872cbc2849"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_e181b24f6b4b41268657cd872cbc2849"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesGetTestJSON-885447229 Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: e181b24f6b4b41268657cd872cbc2849 Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesGetTestJSON-885447229 Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesGetTestJSON-885447229-project Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 2531da7730064bd5b082c1bb259d21eb Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesGetTestJSON-885447229-project Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '2d7fccb3-f417-4dfa-9124-464bf8e0d335'} Aug 30 16:05:49.199819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. (HTTP 404) (Request-ID: req-1d677256-9a94-429f-8831-b62953a6bfe4) Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:49.200688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi item = cinderclient( Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Aug 30 16:05:49.202084 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Aug 30 16:05:49.203247 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. Aug 30 16:05:49.204508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:05:49.209010 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-727dbdaf-983b-4d53-ac0d-7a7bc7be33ce tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] Returning 404 to user: Volume 2d7fccb3-f417-4dfa-9124-464bf8e0d335 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:05:49.210948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-727dbdaf-983b-4d53-ac0d-7a7bc7be33ce tempest-VolumesGetTestJSON-885447229 tempest-VolumesGetTestJSON-885447229-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335" status: 404 len: 109 microversion: 2.1 time: 0.048222 Aug 30 16:05:49.211983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 394/779] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:49 2022] GET /compute/v2.1/os-volumes/2d7fccb3-f417-4dfa-9124-464bf8e0d335 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:05:49.223203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-847e09cd-1812-4ad1-8aab-1b0c32cbfb49 req-adb83889-8302-4c0a-8b58-42bf7b97e22b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5", "tag": "cec1a63d-0719-472d-b588-70e4dc1fac0d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:49.233375 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-847e09cd-1812-4ad1-8aab-1b0c32cbfb49 req-adb83889-8302-4c0a-8b58-42bf7b97e22b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.233890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-847e09cd-1812-4ad1-8aab-1b0c32cbfb49 req-adb83889-8302-4c0a-8b58-42bf7b97e22b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.234327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-847e09cd-1812-4ad1-8aab-1b0c32cbfb49 req-adb83889-8302-4c0a-8b58-42bf7b97e22b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.249653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-847e09cd-1812-4ad1-8aab-1b0c32cbfb49 req-adb83889-8302-4c0a-8b58-42bf7b97e22b service nova] Creating event network-changed:cec1a63d-0719-472d-b588-70e4dc1fac0d for instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 on hv-cinder-85505 Aug 30 16:05:49.256124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-847e09cd-1812-4ad1-8aab-1b0c32cbfb49 req-adb83889-8302-4c0a-8b58-42bf7b97e22b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037495 Aug 30 16:05:49.257529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 386/780] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:49.329539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-89cef513-eb47-48d6-b342-9ad164d568e8 req-91dff437-2197-4718-9278-47406e09ce13 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "name": "network-vif-plugged", "status": "completed", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:49.339237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:49.341060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-89cef513-eb47-48d6-b342-9ad164d568e8 req-91dff437-2197-4718-9278-47406e09ce13 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.341618 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-89cef513-eb47-48d6-b342-9ad164d568e8 req-91dff437-2197-4718-9278-47406e09ce13 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.342051 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-89cef513-eb47-48d6-b342-9ad164d568e8 req-91dff437-2197-4718-9278-47406e09ce13 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.355540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-89cef513-eb47-48d6-b342-9ad164d568e8 req-91dff437-2197-4718-9278-47406e09ce13 service nova] Creating event network-vif-plugged:5194bcb5-34ff-4ad0-a9c9-88ff1f060707 for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 on hv-cinder-85505 Aug 30 16:05:49.360944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-89cef513-eb47-48d6-b342-9ad164d568e8 req-91dff437-2197-4718-9278-47406e09ce13 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035481 Aug 30 16:05:49.362141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 395/781] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:49.855267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:49.855985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:49.862848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.863325 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.863886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.864589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:49.865041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:49.865489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:49.999573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:50.019907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7909f865-69a2-49b4-a336-0a931c12fbe3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.168967 Aug 30 16:05:50.020624 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 387/782] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:49 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:50.187919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:50.188610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:50.195062 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.195539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.195964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.196649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:50.197097 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:50.197553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:50.336772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:50.339306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=100 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:50.346946 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-39d90e1a-d83e-49ab-8e53-a3b98ea07893 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.163836 Aug 30 16:05:50.347496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 396/783] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:50 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:51.040902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:51.041571 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:51.049270 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.049853 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.050266 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.051030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.051485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.051903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.187119 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:51.195802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3ee05e00-611a-40ae-be65-7652de373bf1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.159116 Aug 30 16:05:51.196594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 388/784] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:51 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:51.369506 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:51.370407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:51.378241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.378962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.379373 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.380055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:51.381447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:51.381924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:51.532174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:51.541686 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51f74b82-b283-4852-9ccd-4253eaa75abd tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1574 microversion: 2.1 time: 0.176275 Aug 30 16:05:51.542375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 397/785] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:51 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:52.144207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a3d5577-715b-4dbd-a13e-58a08c8d9b92 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843e6e790>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.193844 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a3d5577-715b-4dbd-a13e-58a08c8d9b92 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/508965f2-ed90-4e08-a85c-5af760e4fd43" status: 200 len: 350 microversion: 2.1 time: 0.053401 Aug 30 16:05:52.194404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 389/786] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/os-volumes/508965f2-ed90-4e08-a85c-5af760e4fd43 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:52.217386 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.217969 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.223968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.224440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.224858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.225723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.226166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.226604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.367949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:52.376290 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6fd16517-09d3-496b-afc2-bf0652d3be26 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.162830 Aug 30 16:05:52.376901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 398/787] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:52.563227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:52.563834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:52.570129 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.570618 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.571052 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.571736 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:52.572186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:52.572602 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:52.711009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:52.719418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-767d1506-4fb8-4ffe-81f9-8235650f4db4 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1561 microversion: 2.1 time: 0.160145 Aug 30 16:05:52.719954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 390/788] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:52 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1561 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:53.397525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.398391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:53.405205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.405795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.406223 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.406910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:53.407374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:53.407789 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:53.537298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:53.537495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-563360d7-bcf4-491c-8613-c2f0bfc92853 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843e6e160>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:53.545388 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0f679d35-ad34-4001-8f4f-0f6615f6cff7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.151757 Aug 30 16:05:53.545944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 399/789] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:53.585014 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-563360d7-bcf4-491c-8613-c2f0bfc92853 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/2a98edc0-5261-4836-88ef-21d97fdf5798" status: 200 len: 350 microversion: 2.1 time: 0.051262 Aug 30 16:05:53.585620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 391/790] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:53 2022] GET /compute/v2.1/os-volumes/2a98edc0-5261-4836-88ef-21d97fdf5798 => generated 350 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:54.570358 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:54.571258 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:54.582228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.583033 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.583743 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.584868 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:54.585667 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:54.586397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:54.726248 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:54.734754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3fb1c720-6133-4820-9488-2d5b1c0b4f0c tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.171043 Aug 30 16:05:54.735319 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 400/791] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:54.955672 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a0c4890e-c3d0-4796-afaa-9bb6fac4b247 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843ebd310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.017066 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a0c4890e-c3d0-4796-afaa-9bb6fac4b247 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/1031458a-d0ee-4b25-94b2-a6a4e405d969" status: 200 len: 351 microversion: 2.1 time: 0.068501 Aug 30 16:05:55.017669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 392/792] 10.222.0.20 () {58 vars in 1245 bytes} [Tue Aug 30 16:05:54 2022] GET /compute/v2.1/os-volumes/1031458a-d0ee-4b25-94b2-a6a4e405d969 => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:55.035655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-62815d7b-d76b-4a5f-b156-4dac32db7f46 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843ffaca0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.118568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-62815d7b-d76b-4a5f-b156-4dac32db7f46 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.088955 Aug 30 16:05:55.119141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 401/793] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:55.132698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2df77d5e-d3da-4b65-8188-3871683e59d3 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843e86820>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.216711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2df77d5e-d3da-4b65-8188-3871683e59d3 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.087886 Aug 30 16:05:55.217281 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 393/794] 10.222.0.20 () {58 vars in 1149 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:55.232490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-27169baa-4f98-4ede-84cd-5369623a1480 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843fbf820>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.324113 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-27169baa-4f98-4ede-84cd-5369623a1480 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.097645 Aug 30 16:05:55.324680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 402/795] 10.222.0.20 () {58 vars in 1134 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:55.337911 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c5ef948-8f77-42ce-b66a-10edae663bd5 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843e05700>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.421159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c5ef948-8f77-42ce-b66a-10edae663bd5 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.087332 Aug 30 16:05:55.421780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 394/796] 10.222.0.20 () {58 vars in 1167 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:55.434977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9dbd1904-2126-4b75-b247-35a27e58628a tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4848113700>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.493416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-bb7c5ce8-f8f2-4788-add3-d382f4db675a req-f531c275-783d-45f2-a282-b5a21ee93982 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5", "name": "network-vif-plugged", "status": "completed", "tag": "cec1a63d-0719-472d-b588-70e4dc1fac0d"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:05:55.505952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bb7c5ce8-f8f2-4788-add3-d382f4db675a req-f531c275-783d-45f2-a282-b5a21ee93982 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.506823 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bb7c5ce8-f8f2-4788-add3-d382f4db675a req-f531c275-783d-45f2-a282-b5a21ee93982 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.507319 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-bb7c5ce8-f8f2-4788-add3-d382f4db675a req-f531c275-783d-45f2-a282-b5a21ee93982 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.519018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-bb7c5ce8-f8f2-4788-add3-d382f4db675a req-f531c275-783d-45f2-a282-b5a21ee93982 service nova] Creating event network-vif-plugged:cec1a63d-0719-472d-b588-70e4dc1fac0d for instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 on hv-cinder-85505 Aug 30 16:05:55.524725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-bb7c5ce8-f8f2-4788-add3-d382f4db675a req-f531c275-783d-45f2-a282-b5a21ee93982 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035255 Aug 30 16:05:55.525453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9dbd1904-2126-4b75-b247-35a27e58628a tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.093839 Aug 30 16:05:55.525671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 395/797] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:05:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:05:55.526278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 403/798] 10.222.0.20 () {58 vars in 1170 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:55.539887 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-05e2b8fc-dd4e-43c1-9248-3f67f59fa20f tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843e86c10>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.625750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-05e2b8fc-dd4e-43c1-9248-3f67f59fa20f tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.089973 Aug 30 16:05:55.626358 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 396/799] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:55.639998 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8f9be5b1-a347-410e-bbf4-0c26a9961022 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4848137820>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.732726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8f9be5b1-a347-410e-bbf4-0c26a9961022 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.097251 Aug 30 16:05:55.733270 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 404/800] 10.222.0.20 () {58 vars in 1188 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:05:55.746130 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-78703048-eb97-4287-af24-d2269861c2d9 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] Calling method '.version_select at 0x7f4843e05550>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.758647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:55.759254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:55.772558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.774574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.775347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.776381 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:55.777024 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:55.777817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:55.832409 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-78703048-eb97-4287-af24-d2269861c2d9 tempest-VolumesTestJSON-985296728 tempest-VolumesTestJSON-985296728-project] 10.222.0.20 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.090061 Aug 30 16:05:55.833122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 397/801] 10.222.0.20 () {58 vars in 1155 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:55.917785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:55.925762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bfbc32aa-4440-4036-a1f1-4719aa166f70 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.173949 Aug 30 16:05:55.938908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 405/802] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:55 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:05:56.946686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:56.947940 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=8 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:05:56.954901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:56.956096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:56.965452 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.966042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.966345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:56.967037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:56.967483 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:56.967901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:57.117297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:57.126276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-259f0009-c679-4d84-8a9b-5fd88436d420 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1319 microversion: 2.1 time: 0.181893 Aug 30 16:05:57.126837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 398/803] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:56 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:05:58.147193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:05:58.147798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:05:58.154445 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.154930 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.155359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.156048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:05:58.156502 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:05:58.156922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:05:58.298635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:05:58.306755 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-09151981-60af-4f2d-956e-fa636cbece28 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1507 microversion: 2.1 time: 0.163391 Aug 30 16:05:58.307300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 406/804] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:05:58 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1507 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:13.470174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:13.472527 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:13.474986 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:13.475783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=74 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:13.481374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.481850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.482271 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.482966 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.483409 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.483817 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.518584 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d5c206da-90e0-4759-8660-97feb766fcea tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.052269 Aug 30 16:06:13.519163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 399/805] 10.222.0.20 () {60 vars in 1343 bytes} [Tue Aug 30 16:06:13 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:13.582239 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:13.582765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:13.585292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=15 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:13.585947 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=37 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:13.591683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.592157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.592581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.593294 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.593740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.594153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.619461 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:13.700972 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-08013416-9ad4-4ac0-ae10-e9d917a0cc1c tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 204 len: 0 microversion: 2.20 time: 0.122487 Aug 30 16:06:13.701494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 407/806] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 30 16:06:13 2022] DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:06:13.709873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:13.710478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:13.716523 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.717005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.717489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.718176 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:13.718626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:13.719042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:13.863344 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:13.871727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:13.873210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:13.874415 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1b8e0256-81d8-45a6-b74e-ba36b454addb tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.168498 Aug 30 16:06:13.875023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 400/807] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:06:13 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:06:14.897964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:14.898641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:14.905542 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.906028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.906454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:14.907133 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:14.907575 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:14.907993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.037226 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:15.045619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:15.047040 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:15.048198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6ad3a072-4b1b-49a0-8a66-8f561d2a2ac2 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.154613 Aug 30 16:06:15.048881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 408/808] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:06:14 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:06:15.688348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "98ee9952-1c7d-4665-8a82-2b447f68890c", "device": "/dev/sdb"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:15.691248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:15.697892 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.698372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.698800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.699506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:15.699957 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:15.700374 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:15.981927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8eb9b241-6828-44f4-9477-c4b5c65c5803 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "POST /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.297958 Aug 30 16:06:15.982541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 401/809] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:06:15 2022] POST /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5/os-volume_attachments => generated 194 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:16.078297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:16.079226 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:16.088679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.089420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.089947 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.091219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:16.091769 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:16.092439 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:16.250206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:16.260176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:16.261681 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '252dd6215082420cade91b100c73f100', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6550878193fa4088861f08552a276578', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:16.263052 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f07c95a4-1767-45e1-a429-7e0c841eca9e tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 200 len: 1723 microversion: 2.20 time: 0.194037 Aug 30 16:06:16.263838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 409/810] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:06:16 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 1723 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 30 16:06:17.009170 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-75fd29d0-5c95-43c0-86d2-01786157c58b req-27e68783-6d24-4fe8-b5dc-f31b00ad0c81 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1bcea2ae-51d3-4283-adea-b5ac0c06f8e8", "name": "network-vif-deleted", "tag": "d0d1588a-51b6-424d-ad20-5fcdc6d3f397"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:17.024500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-75fd29d0-5c95-43c0-86d2-01786157c58b req-27e68783-6d24-4fe8-b5dc-f31b00ad0c81 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.026035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-75fd29d0-5c95-43c0-86d2-01786157c58b req-27e68783-6d24-4fe8-b5dc-f31b00ad0c81 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.026658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-75fd29d0-5c95-43c0-86d2-01786157c58b req-27e68783-6d24-4fe8-b5dc-f31b00ad0c81 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:17.061508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-75fd29d0-5c95-43c0-86d2-01786157c58b req-27e68783-6d24-4fe8-b5dc-f31b00ad0c81 service nova] Creating event network-vif-deleted:d0d1588a-51b6-424d-ad20-5fcdc6d3f397 for instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 on hv-cinder-85505 Aug 30 16:06:17.074201 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-75fd29d0-5c95-43c0-86d2-01786157c58b req-27e68783-6d24-4fe8-b5dc-f31b00ad0c81 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.331660 Aug 30 16:06:17.083091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 402/811] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:17.286230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:17.287496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:17.295051 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.295723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.296305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:17.297157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:17.297670 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:17.298143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:17.316097 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] HTTP exception thrown: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Request method failure captured: Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 HTTP/1.1 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPaHdK5lBeqjTm3J0FhGPaH9kpPjDxsUJVOF_GEIvey2jQISaSU_NE3BinnHA0oQ_cxdMzGk_L6VjQM-RPDRNk1U_m6l2TcD9jIlgashTP3s0m4p3nLl5DHcTAa0YopuoYq0fhBbqCDyz5Pl9VKXUKp6WJd3-U2Z9ngZj5Vr17iSfE Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:06:17.317950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6550878193fa4088861f08552a276578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6550878193fa4088861f08552a276578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 252dd6215082420cade91b100c73f100 Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:17.319726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '1bcea2ae-51d3-4283-adea-b5ac0c06f8e8'} Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:17.320573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:17.321895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:17.323028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Returning 404 to user: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:17.323028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5d20f8f7-747b-44db-97ab-b0b7017129ce tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 404 len: 111 microversion: 2.20 time: 0.037065 Aug 30 16:06:17.323028 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 410/812] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:06:17 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:17.330035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cca8e403-e4c1-4584-87df-bd0bcc55fb47 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '.version_select at 0x7f4843ed7310>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:17.358524 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cca8e403-e4c1-4584-87df-bd0bcc55fb47 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149114560" status: 204 len: 0 microversion: 2.20 time: 0.033212 Aug 30 16:06:17.359103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 403/813] 10.222.0.20 () {60 vars in 1262 bytes} [Tue Aug 30 16:06:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1149114560 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 30 16:06:19.182433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:19.182979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:19.189592 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.190066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.190484 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.191187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.191603 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.191997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.206795 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] HTTP exception thrown: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Request method failure captured: Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 HTTP/1.1 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPaHdK5lBeqjTm3J0FhGPaH9kpPjDxsUJVOF_GEIvey2jQISaSU_NE3BinnHA0oQ_cxdMzGk_L6VjQM-RPDRNk1U_m6l2TcD9jIlgashTP3s0m4p3nLl5DHcTAa0YopuoYq0fhBbqCDyz5Pl9VKXUKp6WJd3-U2Z9ngZj5Vr17iSfE Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:06:19.208775 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6550878193fa4088861f08552a276578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6550878193fa4088861f08552a276578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 252dd6215082420cade91b100c73f100 Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.210549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '1bcea2ae-51d3-4283-adea-b5ac0c06f8e8'} Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:19.214088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.215503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.216922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Returning 404 to user: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:19.216922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8311d044-f999-43f9-90d7-bdb89678acba tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 404 len: 111 microversion: 2.20 time: 0.031399 Aug 30 16:06:19.216922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 411/814] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 30 16:06:19 2022] DELETE /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:19.219063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:19.219784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:19.227813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.228304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.228760 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.229473 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:19.229945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:19.230332 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:19.244517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] HTTP exception thrown: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Request method failure captured: Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 HTTP/1.1 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPaHdK5lBeqjTm3J0FhGPaH9kpPjDxsUJVOF_GEIvey2jQISaSU_NE3BinnHA0oQ_cxdMzGk_L6VjQM-RPDRNk1U_m6l2TcD9jIlgashTP3s0m4p3nLl5DHcTAa0YopuoYq0fhBbqCDyz5Pl9VKXUKp6WJd3-U2Z9ngZj5Vr17iSfE Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:06:19.246204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6550878193fa4088861f08552a276578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6550878193fa4088861f08552a276578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 252dd6215082420cade91b100c73f100 Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.247577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '1bcea2ae-51d3-4283-adea-b5ac0c06f8e8'} Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:19.248632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. Aug 30 16:06:19.249889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:19.251054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Returning 404 to user: Instance 1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:19.251054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-167d7dbf-eb2a-4556-a9e2-0a17de7a29f0 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8" status: 404 len: 111 microversion: 2.20 time: 0.032665 Aug 30 16:06:19.251054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 404/815] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:06:19 2022] GET /compute/v2.1/servers/1bcea2ae-51d3-4283-adea-b5ac0c06f8e8 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:20.406170 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.406695 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:20.414185 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.414693 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.415122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.415814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.416287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.416701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.430558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] HTTP exception thrown: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Request method failure captured: Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b HTTP/1.1 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjPaHdK5lBeqjTm3J0FhGPaH9kpPjDxsUJVOF_GEIvey2jQISaSU_NE3BinnHA0oQ_cxdMzGk_L6VjQM-RPDRNk1U_m6l2TcD9jIlgashTP3s0m4p3nLl5DHcTAa0YopuoYq0fhBbqCDyz5Pl9VKXUKp6WJd3-U2Z9ngZj5Vr17iSfE Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:06:20.432159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6550878193fa4088861f08552a276578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6550878193fa4088861f08552a276578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 252dd6215082420cade91b100c73f100 Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.433807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '54113782-135e-4dda-a0e9-600a7fa1ec9b'} Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:20.438090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.439574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.440954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Returning 404 to user: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:20.440954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c30464a1-50f7-4e8c-ad3a-8a59dcb625a1 tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 404 len: 111 microversion: 2.20 time: 0.031439 Aug 30 16:06:20.440954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 412/816] 10.222.0.20 () {60 vars in 1280 bytes} [Tue Aug 30 16:06:20 2022] DELETE /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:20.442250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:20.442985 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] [instance: 54113782-135e-4dda-a0e9-600a7fa1ec9b] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:20.450202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.450794 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.451215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.451930 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:20.452376 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:20.452925 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:20.466505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] HTTP exception thrown: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Request method failure captured: Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b HTTP/1.1 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjPaHdK5lBeqjTm3J0FhGPaH9kpPjDxsUJVOF_GEIvey2jQISaSU_NE3BinnHA0oQ_cxdMzGk_L6VjQM-RPDRNk1U_m6l2TcD9jIlgashTP3s0m4p3nLl5DHcTAa0YopuoYq0fhBbqCDyz5Pl9VKXUKp6WJd3-U2Z9ngZj5Vr17iSfE Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Openstack-Nova-Api-Version: 2.20 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:06:20.468036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/6550878193fa4088861f08552a276578"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/6550878193fa4088861f08552a276578"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_6550878193fa4088861f08552a276578"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 6550878193fa4088861f08552a276578 Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1400011143 Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 252dd6215082420cade91b100c73f100 Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1400011143-project Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.469770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '54113782-135e-4dda-a0e9-600a7fa1ec9b'} Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:20.470554 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. Aug 30 16:06:20.471771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:06:20.472895 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] Returning 404 to user: Instance 54113782-135e-4dda-a0e9-600a7fa1ec9b could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:20.472895 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-15152480-af02-47ce-a01f-3168e628bbad tempest-AttachVolumeShelveTestJSON-1400011143 tempest-AttachVolumeShelveTestJSON-1400011143-project] 10.222.0.20 "GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b" status: 404 len: 111 microversion: 2.20 time: 0.031112 Aug 30 16:06:20.472895 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 405/817] 10.222.0.20 () {60 vars in 1277 bytes} [Tue Aug 30 16:06:20 2022] GET /compute/v2.1/servers/54113782-135e-4dda-a0e9-600a7fa1ec9b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 30 16:06:29.325583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-200e3424-4c34-491a-960c-af4e8ccfaebb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: .version_select at 0x7f4843fbf310>, body: {"keypair": {"name": "tempest-keypair-1836700732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNQM6Zlwc9dQJDhTcuRLstfI4c68NDg7eyLKNYf7KQX+yVWdwQqL4qYCid/gXEnN1QFLaECi68x6rPaqi8E1Cuv6ORcIkvW57Lolj0ibXDhOgWw5tPtpaiUeioKD4+6WHw=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:29.342236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-200e3424-4c34-491a-960c-af4e8ccfaebb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:29.346467 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-200e3424-4c34-491a-960c-af4e8ccfaebb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for user 1cd3f1cbe0eb496f8e4c0692366fdefb and project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:29.372923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-200e3424-4c34-491a-960c-af4e8ccfaebb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.193249 Aug 30 16:06:29.373576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 413/818] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:06:29 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:30.978134 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1863029597", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81d1bc24-854e-40b0-bd62-d7bb6921d20e"}], "security_groups": [{"name": "tempest-securitygroup--1102303759"}], "key_name": "tempest-keypair-1836700732", "user_data": "}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:30.987721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:30.988397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=29,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:31.090108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] validate_networks() for [('81d1bc24-854e-40b0-bd62-d7bb6921d20e', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:06:31.525341 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:06:31.526130 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:06:31.526874 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:06:31.527349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:06:31.528103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:06:31.539150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.540074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.540546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.541531 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:31.542317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:31.543074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:31.565696 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:06:31.571777 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for user 1cd3f1cbe0eb496f8e4c0692366fdefb and project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:06:31.584075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:06:31.586395 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:06:31.651476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2dc2038f-50b2-4411-9e55-d6daa7302eb8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.676931 Aug 30 16:06:31.659330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 406/819] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:06:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 686 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:06:31.664888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8559260a-c773-4d2f-ad1d-8a54fcd9727a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:31.667673 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8559260a-c773-4d2f-ad1d-8a54fcd9727a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:31.670630 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:31.750068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8559260a-c773-4d2f-ad1d-8a54fcd9727a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:31.760980 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8559260a-c773-4d2f-ad1d-8a54fcd9727a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1238 microversion: 2.1 time: 0.100932 Aug 30 16:06:31.762370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 414/820] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:31 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1238 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:32.782920 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:32.784154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:32.791692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.792268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.792773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.793578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:32.794104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:32.794631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:32.858183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:32.866436 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-392fefa6-56d5-4760-8fef-9df824b253dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1242 microversion: 2.1 time: 0.087892 Aug 30 16:06:32.867020 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 407/821] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:32 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:33.887438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:33.888720 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:33.895593 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.896417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.896920 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.897701 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:33.898195 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:33.898619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:33.967847 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:33.975870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4961f85e-1b3a-4622-9d82-7b9a34da8d98 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1308 microversion: 2.1 time: 0.092518 Aug 30 16:06:33.977167 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 415/822] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:33 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1308 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:35.002231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:35.003255 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:35.012273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.012763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.013193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.013915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:35.014357 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:35.014780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:35.147291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:35.155358 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cff88be2-0f76-4436-8f5c-02f0f936179b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.159748 Aug 30 16:06:35.155924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 408/823] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:34 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:36.177606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:36.178211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:36.185038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.185553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.185966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.186708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:36.187342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:36.188174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:36.327984 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:36.336650 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-959ea13e-90b5-4312-804a-7000776d7a90 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.163474 Aug 30 16:06:36.348407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 416/824] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:36 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:37.358684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:37.358684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:37.366032 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.366517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.366815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.367485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.367974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.368381 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.507886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:37.516127 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28333676-2a1d-4b11-9fe1-5f419e83c74b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.162503 Aug 30 16:06:37.516724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 409/825] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:37 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:37.734599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-2feae9f4-a3dc-4642-b683-7af7989b614f req-68405c97-9e45-4cbc-a2a5-a29339c67228 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c12da29-7487-4964-af58-1bc74336173a", "tag": "409e10a7-7f54-4da1-949a-6464aba37e15"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:37.745025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2feae9f4-a3dc-4642-b683-7af7989b614f req-68405c97-9e45-4cbc-a2a5-a29339c67228 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:37.745578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2feae9f4-a3dc-4642-b683-7af7989b614f req-68405c97-9e45-4cbc-a2a5-a29339c67228 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:37.745993 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-2feae9f4-a3dc-4642-b683-7af7989b614f req-68405c97-9e45-4cbc-a2a5-a29339c67228 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:37.758257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-2feae9f4-a3dc-4642-b683-7af7989b614f req-68405c97-9e45-4cbc-a2a5-a29339c67228 service nova] Creating event network-changed:409e10a7-7f54-4da1-949a-6464aba37e15 for instance 2c12da29-7487-4964-af58-1bc74336173a on hv-cinder-85505 Aug 30 16:06:37.763178 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-2feae9f4-a3dc-4642-b683-7af7989b614f req-68405c97-9e45-4cbc-a2a5-a29339c67228 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032798 Aug 30 16:06:37.763776 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 417/826] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:38.537051 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:38.537669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:38.545511 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.546125 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.546559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.547314 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:38.548112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:38.548500 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:38.683563 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:38.691214 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-34dbbaac-5885-4c1a-b8b6-29ae28f57c50 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.158639 Aug 30 16:06:38.691763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 410/827] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:38 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:39.712404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:39.713089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:39.719836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.720313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.720778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.721563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:39.722004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:39.722416 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:39.863629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:39.871487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8df1b182-7107-462d-b239-89d4c9324241 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.163835 Aug 30 16:06:39.872055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 418/828] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:39 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:40.894454 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:40.895276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:40.904154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:40.904837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:40.905522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:40.906437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:40.907037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:40.907595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:41.046501 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:41.058158 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a6d9a000-c28c-4775-8b11-ee41918a088a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.168839 Aug 30 16:06:41.058915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 411/829] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:40 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:42.085390 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:42.086110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:42.089066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:42.094830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.095320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.095748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.096441 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:42.096891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:42.097337 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:42.236974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:42.245328 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e1968047-71db-49d6-b76f-858f93d70c85 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.164647 Aug 30 16:06:42.245936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 419/830] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:42 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:43.271492 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:43.272121 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:43.274023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:43.274661 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:43.281249 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.281775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.282217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.282926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:43.283381 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:43.283805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:43.414427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:43.422591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-175d4b23-b5c3-4f4b-b172-4157cf87e695 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.155108 Aug 30 16:06:43.423171 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 412/831] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:43 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:44.447712 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:44.448706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:44.452387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:44.463213 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.464128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.464572 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.465300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:44.465788 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:44.466209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:44.602827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:44.611602 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8766eb77-f8d0-4457-b4c1-ae20f0e679a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.170369 Aug 30 16:06:44.612175 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 420/832] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:44 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:45.636537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:45.637587 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:45.648568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.649419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.650138 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.651824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:45.651954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:45.652328 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:45.806396 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:45.814540 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2468eb1c-c43e-481c-b865-d5e35bc871bc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.184593 Aug 30 16:06:45.815106 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 413/833] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:45 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:46.839704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:46.840683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:46.851589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.852475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.853134 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.854300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:46.855357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:46.855768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:46.995372 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:47.008314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a001050a-ba92-4fc4-85bf-68179fa36516 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.174751 Aug 30 16:06:47.009234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 421/834] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:46 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:48.034477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:48.035333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:48.046775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.047671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.048393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.049586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:48.050340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:48.051243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:48.200833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:48.215044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-844b05ca-5f92-4088-8f5f-66026e58cb56 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.187268 Aug 30 16:06:48.227970 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 414/835] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:48 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:49.237482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:49.238065 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:49.244963 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.245476 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.245904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.246593 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.247037 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.247448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.289979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:49.290531 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:49.297515 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.298005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.298449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.299153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:49.299603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:49.300027 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:49.378359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:49.386489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lazy-loading 'services' on Instance uuid fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:06:49.387704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a239a5a0-0395-4a49-9f1f-9f4fbe6038dd tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.154250 Aug 30 16:06:49.388454 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 422/836] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:49 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:49.463578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e2fe3d0f-d82e-4743-aee7-6551cca1abbe tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5/os-volume_attachments/98ee9952-1c7d-4665-8a82-2b447f68890c" status: 202 len: 0 microversion: 2.1 time: 0.177432 Aug 30 16:06:49.464174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 415/837] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:06:49 2022] DELETE /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5/os-volume_attachments/98ee9952-1c7d-4665-8a82-2b447f68890c => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:06:50.347778 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-7efcf3d1-167f-40e2-a125-2c0aed1d0ca1 req-d2052dd8-ee35-4140-b4bf-6651c814410f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c12da29-7487-4964-af58-1bc74336173a", "name": "network-vif-plugged", "status": "completed", "tag": "409e10a7-7f54-4da1-949a-6464aba37e15"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:50.358430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-7efcf3d1-167f-40e2-a125-2c0aed1d0ca1 req-d2052dd8-ee35-4140-b4bf-6651c814410f service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.358932 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-7efcf3d1-167f-40e2-a125-2c0aed1d0ca1 req-d2052dd8-ee35-4140-b4bf-6651c814410f service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.359349 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-7efcf3d1-167f-40e2-a125-2c0aed1d0ca1 req-d2052dd8-ee35-4140-b4bf-6651c814410f service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.371558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-7efcf3d1-167f-40e2-a125-2c0aed1d0ca1 req-d2052dd8-ee35-4140-b4bf-6651c814410f service nova] Creating event network-vif-plugged:409e10a7-7f54-4da1-949a-6464aba37e15 for instance 2c12da29-7487-4964-af58-1bc74336173a on hv-cinder-85505 Aug 30 16:06:50.376574 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-7efcf3d1-167f-40e2-a125-2c0aed1d0ca1 req-d2052dd8-ee35-4140-b4bf-6651c814410f service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033490 Aug 30 16:06:50.377192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 423/838] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:50.410657 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.411976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.418507 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.418987 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.419416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.420109 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.420559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.421042 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.558660 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:50.566619 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5f6c529c-b1ed-49a1-9860-822bee3a87b4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.160728 Aug 30 16:06:50.567477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 416/839] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:50 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:50.594629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.595215 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.601645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.602132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.602565 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.603250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.603704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.604123 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.631035 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:06:50.711798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ef6fe796-2ee3-42d7-a968-a8cf5978a247 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 204 len: 0 microversion: 2.1 time: 0.121284 Aug 30 16:06:50.712376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 424/840] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:06:50 2022] DELETE /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:06:50.720857 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:50.721501 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:50.727571 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.728047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.728472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.729153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:50.729938 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:50.730364 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:50.870680 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:50.878861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-80853078-20c7-472e-8d9b-b064318d60e5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1513 microversion: 2.1 time: 0.161844 Aug 30 16:06:50.879435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 417/841] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:50 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.593835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.594510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.601377 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.601851 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.602271 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.602977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.603408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.603827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.743729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:51.754004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f12da12f-767f-46ca-aa17-5cb3e6f273c9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.166889 Aug 30 16:06:51.754935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 425/842] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:51.903959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:51.904945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:51.912465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.912943 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.913413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:51.914091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:51.914863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:51.915286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.055419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.066850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e1f3fa3e-4499-4141-8b94-758947df1f25 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1513 microversion: 2.1 time: 0.169312 Aug 30 16:06:52.067605 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 418/843] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:51 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1513 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:52.786218 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:52.786922 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:52.795906 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.796506 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.796938 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.797672 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:52.798120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:52.798542 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:52.944623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:52.954998 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9ed931a0-073c-4a5d-a4cf-e13792dc1e01 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1364 microversion: 2.1 time: 0.174860 Aug 30 16:06:52.955560 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 426/844] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:52 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1364 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:53.094603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.095193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:53.102385 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.102852 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.103298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.104011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.104473 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.105207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.247944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:53.256982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0f72e095-aa8a-408b-aaba-220bbb915ca6 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1513 microversion: 2.1 time: 0.168456 Aug 30 16:06:53.257671 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 419/845] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:53 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1513 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:53.971970 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-fe4b6e1b-fd6c-419a-a467-d044c28285c8 req-f519f0b7-dbc5-48f1-8faa-6377723d2ee4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5", "name": "network-vif-deleted", "tag": "cec1a63d-0719-472d-b588-70e4dc1fac0d"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:53.976509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:53.977396 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:53.984505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.984996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.985749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.986680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe4b6e1b-fd6c-419a-a467-d044c28285c8 req-f519f0b7-dbc5-48f1-8faa-6377723d2ee4 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.986830 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:53.987213 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe4b6e1b-fd6c-419a-a467-d044c28285c8 req-f519f0b7-dbc5-48f1-8faa-6377723d2ee4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.987676 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:53.988161 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fe4b6e1b-fd6c-419a-a467-d044c28285c8 req-f519f0b7-dbc5-48f1-8faa-6377723d2ee4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:53.988504 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.002712 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-fe4b6e1b-fd6c-419a-a467-d044c28285c8 req-f519f0b7-dbc5-48f1-8faa-6377723d2ee4 service nova] Creating event network-vif-deleted:cec1a63d-0719-472d-b588-70e4dc1fac0d for instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 on hv-cinder-85505 Aug 30 16:06:54.008164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-fe4b6e1b-fd6c-419a-a467-d044c28285c8 req-f519f0b7-dbc5-48f1-8faa-6377723d2ee4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042386 Aug 30 16:06:54.008895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 427/846] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:54.137522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:54.146279 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-191ad129-de4d-49a3-995d-1ed9b5868e12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1549 microversion: 2.1 time: 0.173936 Aug 30 16:06:54.146876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 420/847] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:53 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1549 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:06:54.171342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.171925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.178610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.179101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.179538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.180234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.180881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.181325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.275986 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-82a81b6e-825f-4009-992a-3e64c7c76e8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110764 Aug 30 16:06:54.276594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 428/848] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-interface => generated 284 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:06:54.278625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:54.279410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:54.286260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.286752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.287298 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.288229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.288677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.289093 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.333523 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:54.335174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:54.335545 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:54.336004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lazy-loading 'fault' on Instance uuid fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:06:54.379645 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:06:54.387370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0382286-c8b6-47b2-ad5f-749d89663e5a tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 200 len: 1309 microversion: 2.1 time: 0.113096 Aug 30 16:06:54.387872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 421/849] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:54 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 1309 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:06:55.408886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:06:55.409619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:06:55.416361 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.416843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.417275 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.417986 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:55.418433 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:55.418855 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:55.433477 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] HTTP exception thrown: Instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 could not be found. Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Request method failure captured: Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 HTTP/1.1 Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjVXgSzjnIqIfoJRbpLaRp9zm41-EdaysOgq3tpsm0nbYZZkVXPSp_8uzC4fSGfdIDSsVZ_govSPsLul-jkQbS6nSyMEM57PqhUECb3Cl0PpLFw1LzDau1ovT1laxeSGXmdBvmgLiEAnV4qxE6XSBfk3b7_SMeYupGRl31dgUyVKgUo Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: ebf5f0daa032440ab81e5abda55f6e82 Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1510452202 Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:06:55.435149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-VolumesSnapshotTestJSON-1510452202 Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: ebf5f0daa032440ab81e5abda55f6e82 Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1510452202 Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-VolumesSnapshotTestJSON-1510452202-project Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 08661f6694ff44a0a4d15c792b54bb97 Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-VolumesSnapshotTestJSON-1510452202-project Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 could not be found. Aug 30 16:06:55.436645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': 'fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5'} Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 could not be found. Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:06:55.440846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 could not be found. Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 could not be found. Aug 30 16:06:55.442282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:06:55.444458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Returning 404 to user: Instance fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:06:55.444458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6a1d7ef0-7329-4807-af18-109f62219121 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5" status: 404 len: 111 microversion: 2.1 time: 0.032294 Aug 30 16:06:55.444458 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 429/850] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:06:55 2022] GET /compute/v2.1/servers/fe8ad1dd-cbef-4739-b3fc-f61d1d8c3ec5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:06:56.025051 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-adfc5df3-dcce-42c2-a1a2-46b2c8c325f8 req-b8acc5b6-325e-438e-ba05-735f810db751 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c12da29-7487-4964-af58-1bc74336173a", "tag": "409e10a7-7f54-4da1-949a-6464aba37e15"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:06:56.035723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-adfc5df3-dcce-42c2-a1a2-46b2c8c325f8 req-b8acc5b6-325e-438e-ba05-735f810db751 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:06:56.036201 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-adfc5df3-dcce-42c2-a1a2-46b2c8c325f8 req-b8acc5b6-325e-438e-ba05-735f810db751 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:06:56.036632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-adfc5df3-dcce-42c2-a1a2-46b2c8c325f8 req-b8acc5b6-325e-438e-ba05-735f810db751 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:06:56.040884 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:06:56.049233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-adfc5df3-dcce-42c2-a1a2-46b2c8c325f8 req-b8acc5b6-325e-438e-ba05-735f810db751 service nova] Creating event network-changed:409e10a7-7f54-4da1-949a-6464aba37e15 for instance 2c12da29-7487-4964-af58-1bc74336173a on hv-cinder-85505 Aug 30 16:06:56.054540 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-adfc5df3-dcce-42c2-a1a2-46b2c8c325f8 req-b8acc5b6-325e-438e-ba05-735f810db751 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033169 Aug 30 16:06:56.055136 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 422/851] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:06:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:03.327102 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-968379099", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "networks": [{"uuid": "f8ed2ccc-9e41-4749-9a9b-f453e44c8e33"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:03.381585 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] validate_networks() for [('f8ed2ccc-9e41-4749-9a9b-f453e44c8e33', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:07:03.841518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:07:03.841936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:07:03.842401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:07:03.842791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:07:03.843232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:07:03.853647 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.854125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.854897 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.855612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:03.856059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:03.856473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:03.862224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:03.877154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Getting quotas for project ebf5f0daa032440ab81e5abda55f6e82. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:07:03.881432 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Getting quotas for user 08661f6694ff44a0a4d15c792b54bb97 and project ebf5f0daa032440ab81e5abda55f6e82. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:07:03.892849 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:07:03.895279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:07:03.942515 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9bd0ab0a-fa1b-4804-a5d2-de94d41270fd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.619315 Aug 30 16:07:03.943153 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 430/852] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:07:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 621 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:07:03.955721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2bff512a-6214-4556-b839-ffe1b322dfb3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:03.956538 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2bff512a-6214-4556-b839-ffe1b322dfb3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:03.958636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=50,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:04.017561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2bff512a-6214-4556-b839-ffe1b322dfb3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:04.024474 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2bff512a-6214-4556-b839-ffe1b322dfb3 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1218 microversion: 2.1 time: 0.074110 Aug 30 16:07:04.025035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 423/853] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:03 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1218 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:05.046035 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:05.046669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:05.052855 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.053368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.054199 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.054475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:05.054918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:05.055329 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:05.125000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:05.134164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f3945113-7a55-40cb-9670-52a21efa5b64 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1278 microversion: 2.1 time: 0.092502 Aug 30 16:07:05.135040 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 431/854] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:05 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:06.156199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:06.156880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:06.163370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:06.163865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:06.164290 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:06.165012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:06.165476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:06.165901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:06.306384 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:06.314438 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bdb962df-10cd-4a93-a68c-0d960f9e88a7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.162356 Aug 30 16:07:06.315005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 424/855] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:06 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:06.576666 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-49a0ca66-bab1-4ee4-b6a4-1ca8878b9822 req-b29b61ec-f912-41b6-a63f-803682c1f001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b1cdc538-a2b4-4e1d-8b87-a394851bd522", "tag": "3690b648-84b8-4c7a-8d61-4816a4ae2a89"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:06.588751 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-49a0ca66-bab1-4ee4-b6a4-1ca8878b9822 req-b29b61ec-f912-41b6-a63f-803682c1f001 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:06.589525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-49a0ca66-bab1-4ee4-b6a4-1ca8878b9822 req-b29b61ec-f912-41b6-a63f-803682c1f001 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:06.589953 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-49a0ca66-bab1-4ee4-b6a4-1ca8878b9822 req-b29b61ec-f912-41b6-a63f-803682c1f001 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:06.601864 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-49a0ca66-bab1-4ee4-b6a4-1ca8878b9822 req-b29b61ec-f912-41b6-a63f-803682c1f001 service nova] Creating event network-changed:3690b648-84b8-4c7a-8d61-4816a4ae2a89 for instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 on hv-cinder-85505 Aug 30 16:07:06.607228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-49a0ca66-bab1-4ee4-b6a4-1ca8878b9822 req-b29b61ec-f912-41b6-a63f-803682c1f001 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035161 Aug 30 16:07:06.607882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 432/856] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:07.337602 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:07.339945 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:07.346982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.347478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.347906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.348751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:07.349044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:07.349505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:07.491287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:07.499430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d0374d58-fb17-4fbb-92eb-ac85689d3ea5 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.167454 Aug 30 16:07:07.499993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 425/857] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:07 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:08.521372 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:08.521949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:08.528525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.529002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.529475 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.530158 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:08.530609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:08.531018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:08.664852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:08.672606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-69040cb2-c31e-484d-bb59-625452b33af1 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.156156 Aug 30 16:07:08.673403 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 433/858] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:08 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:09.694510 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:09.695090 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:09.702482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.703004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.703470 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:09.704208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:09.704793 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:09.705273 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:09.849111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:09.860301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7ef06172-c4d0-457c-8551-70520a01892e tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.170029 Aug 30 16:07:09.860868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 426/859] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:09 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:10.883231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:10.884145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:10.894204 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.894689 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.895118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:10.895807 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:10.896254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:10.896706 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:11.032296 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:11.040079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-0a95ada4-ddda-443f-9c70-248e699eb0c4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.162862 Aug 30 16:07:11.040655 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 434/860] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:10 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:12.064198 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:12.064937 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:12.072250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.072753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.073203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.073952 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.074424 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.074866 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.209894 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:12.221663 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0fdb9e65-d8b6-457d-a9d2-f5e3b010f561 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.163667 Aug 30 16:07:12.222429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 427/861] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:12 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:12.579579 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-13d5ee59-f6ca-412c-a317-0adbdf4d2112 req-8f454f91-155c-4a10-a512-c693490f6fb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cdc538-a2b4-4e1d-8b87-a394851bd522", "name": "network-vif-plugged", "status": "completed", "tag": "3690b648-84b8-4c7a-8d61-4816a4ae2a89"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:12.589836 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-13d5ee59-f6ca-412c-a317-0adbdf4d2112 req-8f454f91-155c-4a10-a512-c693490f6fb7 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:12.590306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-13d5ee59-f6ca-412c-a317-0adbdf4d2112 req-8f454f91-155c-4a10-a512-c693490f6fb7 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:12.591346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-13d5ee59-f6ca-412c-a317-0adbdf4d2112 req-8f454f91-155c-4a10-a512-c693490f6fb7 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:12.601934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-13d5ee59-f6ca-412c-a317-0adbdf4d2112 req-8f454f91-155c-4a10-a512-c693490f6fb7 service nova] Creating event network-vif-plugged:3690b648-84b8-4c7a-8d61-4816a4ae2a89 for instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 on hv-cinder-85505 Aug 30 16:07:12.607238 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-13d5ee59-f6ca-412c-a317-0adbdf4d2112 req-8f454f91-155c-4a10-a512-c693490f6fb7 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031636 Aug 30 16:07:12.607852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 435/862] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:13.247371 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:13.247978 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:13.254679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:13.255164 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:13.255590 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:13.256271 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:13.256714 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:13.257128 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:13.393792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:13.405951 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1808bbb3-33ce-4641-8c81-03d787846be7 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.162091 Aug 30 16:07:13.406864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 428/863] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:13 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:14.428548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:14.429794 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:14.436396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:14.437564 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:14.449468 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.450233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.450931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:14.452042 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:14.452780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:14.453510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:14.597974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:14.606511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1614e593-88db-4019-ab81-cdc4413cfe43 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1318 microversion: 2.1 time: 0.180401 Aug 30 16:07:14.607065 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 436/864] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:14 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:15.630675 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:15.631288 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:15.633209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:15.639281 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.639763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.640192 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.640889 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.641363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.641766 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.778486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:15.788353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-eb74eb81-c293-469d-a718-65a88073774b tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1507 microversion: 2.1 time: 0.162888 Aug 30 16:07:15.788925 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 429/865] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:15 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1507 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:15.812642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "291d1ad7-0243-4595-878f-c8dc11f614ca", "device": "/dev/sdb"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:15.815544 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:15.818038 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:15.823357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.823838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.824265 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:15.824954 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:15.825424 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:15.825833 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:16.125976 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c331d8f1-40e3-4037-9b0c-77c91ca13ecc tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "POST /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.317309 Aug 30 16:07:16.126698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 437/866] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:07:15 2022] POST /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522/os-volume_attachments => generated 194 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:07:27.185570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:27.186276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:27.186276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:27.187927 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=40,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:27.192949 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-15585da4-f7bc-4a1f-9f42-cc8533605d28 req-c9f648a1-7380-4249-8c64-660c93d51d0b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:27.193496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=15 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:27.196276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:27.201562 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.202453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.203068 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.203911 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.204419 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.205043 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.205434 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-15585da4-f7bc-4a1f-9f42-cc8533605d28 req-c9f648a1-7380-4249-8c64-660c93d51d0b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.206231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-15585da4-f7bc-4a1f-9f42-cc8533605d28 req-c9f648a1-7380-4249-8c64-660c93d51d0b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.206660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-15585da4-f7bc-4a1f-9f42-cc8533605d28 req-c9f648a1-7380-4249-8c64-660c93d51d0b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.220006 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-15585da4-f7bc-4a1f-9f42-cc8533605d28 req-c9f648a1-7380-4249-8c64-660c93d51d0b service nova] Creating event network-changed:5194bcb5-34ff-4ad0-a9c9-88ff1f060707 for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 on hv-cinder-85505 Aug 30 16:07:27.225841 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-15585da4-f7bc-4a1f-9f42-cc8533605d28 req-c9f648a1-7380-4249-8c64-660c93d51d0b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041559 Aug 30 16:07:27.227115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 438/867] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:27.238457 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:27.324392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d26e3aaa-1469-48ac-b904-333148c64837 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "DELETE /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 204 len: 0 microversion: 2.1 time: 0.142823 Aug 30 16:07:27.325060 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 430/868] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:27 2022] DELETE /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:27.333984 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:27.334838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:27.341205 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.341736 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.342162 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.342850 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:27.343301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:27.343722 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:27.480718 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:27.488815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae64bc5a-336f-4aed-af55-1a61646b68b7 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.159146 Aug 30 16:07:27.489445 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 439/869] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:27 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:28.516568 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:28.517184 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:28.525424 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.525907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.526333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:28.527023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:28.527470 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:28.527886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:28.661055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:28.669159 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c24e0408-f5d0-49ae-b7d3-85c6dfebcc1f tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.159597 Aug 30 16:07:28.669771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 431/870] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:28 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:29.690827 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:29.691430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:29.698407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:29.698903 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:29.699358 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:29.700049 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:29.700500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:29.700923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:29.850005 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:29.858730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1787f892-babd-4053-8962-9cd0f6d6531a tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.171821 Aug 30 16:07:29.859297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 440/871] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:29 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:30.884546 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:30.886360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:30.900850 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:30.901311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:30.901736 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:30.902427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:30.902880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:30.903297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:31.038800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:31.047117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01d1f9f2-1b71-4e94-af1d-8194d5ea2355 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.169330 Aug 30 16:07:31.047695 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 432/872] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:30 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:31.180224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:31.180791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:31.187450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:31.187924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:31.188369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:31.189708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:31.189708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:31.190061 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:31.233086 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-325c10e3-edfb-422a-a748-b106e7f6c0ce tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/ips" status: 200 len: 145 microversion: 2.1 time: 0.056945 Aug 30 16:07:31.234102 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 441/873] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:07:31 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/ips => generated 145 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:32.068137 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:32.069734 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:32.077941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.078336 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.079003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.079893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.080393 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.080846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.309352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:32.318129 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1108229e-432b-46ac-b07d-d1fb922d9e93 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1567 microversion: 2.1 time: 0.253742 Aug 30 16:07:32.318975 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 433/874] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:32 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1567 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:32.556536 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-f8bf8123-afcf-4c33-81b7-b6a70b840b69 req-859c270f-9156-403b-80e4-7f4bc0665202 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e9ad95d7-a73d-4474-acad-c17b7cfd1b09", "name": "network-vif-deleted", "tag": "5194bcb5-34ff-4ad0-a9c9-88ff1f060707"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:32.566925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f8bf8123-afcf-4c33-81b7-b6a70b840b69 req-859c270f-9156-403b-80e4-7f4bc0665202 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:32.567402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f8bf8123-afcf-4c33-81b7-b6a70b840b69 req-859c270f-9156-403b-80e4-7f4bc0665202 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:32.567841 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f8bf8123-afcf-4c33-81b7-b6a70b840b69 req-859c270f-9156-403b-80e4-7f4bc0665202 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:32.579503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-f8bf8123-afcf-4c33-81b7-b6a70b840b69 req-859c270f-9156-403b-80e4-7f4bc0665202 service nova] Creating event network-vif-deleted:5194bcb5-34ff-4ad0-a9c9-88ff1f060707 for instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 on hv-cinder-85505 Aug 30 16:07:32.584494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-f8bf8123-afcf-4c33-81b7-b6a70b840b69 req-859c270f-9156-403b-80e4-7f4bc0665202 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031828 Aug 30 16:07:32.585150 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 442/875] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:33.340520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:33.341138 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:33.347968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:33.348404 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:33.348906 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:33.349708 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:33.350143 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:33.350693 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:33.382888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:33.383280 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:33.383716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:33.384423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lazy-loading 'fault' on Instance uuid e9ad95d7-a73d-4474-acad-c17b7cfd1b09 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:33.428677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f00011535aa4836b1cc410dd5d97beb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '340ea9b1270443f58c051cfb5699caa5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:33.436873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-31b2a082-39d1-45cd-a04e-832714a4a7f2 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 200 len: 1223 microversion: 2.1 time: 0.100327 Aug 30 16:07:33.437475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 434/876] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:33 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:34.372966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "cade0bbf-76b5-4605-a0c3-0f3600c33c0d"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:34.375384 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:34.382192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.382668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.383088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.383757 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.384196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.384604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.458451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:34.459050 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] [instance: e9ad95d7-a73d-4474-acad-c17b7cfd1b09] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:34.465793 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.466397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.466851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.467536 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:34.467998 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:34.468392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:34.482229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] HTTP exception thrown: Instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 could not be found. Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Request method failure captured: Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 HTTP/1.1 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjRdgylf4ZFU3RM5pyyTdgC4XifUtfFMJBQz8x3ve1EbKpXe2rGh9_isRNZCJi_V8fE6NiFvTvrG3IfJsYfH8lcbW0CvKOeZyCLIiO3uiF33e9LGt-FsHUSoInL8VUsEq3buU9ILGtHgacLKIU_Sr0OurFoFxtNJsVvNbnlQK2kPnx4 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 340ea9b1270443f58c051cfb5699caa5 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-TestShelveInstance-1546589003 Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:07:34.483903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340ea9b1270443f58c051cfb5699caa5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/340ea9b1270443f58c051cfb5699caa5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/340ea9b1270443f58c051cfb5699caa5"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_340ea9b1270443f58c051cfb5699caa5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-TestShelveInstance-1546589003 Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 340ea9b1270443f58c051cfb5699caa5 Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestShelveInstance-1546589003 Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-TestShelveInstance-1546589003-project Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 4f00011535aa4836b1cc410dd5d97beb Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-TestShelveInstance-1546589003-project Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 could not be found. Aug 30 16:07:34.485692 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': 'e9ad95d7-a73d-4474-acad-c17b7cfd1b09'} Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 could not be found. Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:34.486701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 could not be found. Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 could not be found. Aug 30 16:07:34.488253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:34.489878 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Returning 404 to user: Instance e9ad95d7-a73d-4474-acad-c17b7cfd1b09 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:34.489878 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48bc0bfa-c3eb-4055-bf5e-9effb8ea7431 tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09" status: 404 len: 111 microversion: 2.1 time: 0.030706 Aug 30 16:07:34.489878 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 435/877] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:34 2022] GET /compute/v2.1/servers/e9ad95d7-a73d-4474-acad-c17b7cfd1b09 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:34.661835 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bdb006fc-0277-4fcf-b13b-2e3489adf91c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] Calling method '.version_select at 0x7f4843e6e940>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:34.689179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bdb006fc-0277-4fcf-b13b-2e3489adf91c tempest-TestShelveInstance-1546589003 tempest-TestShelveInstance-1546589003-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-247566484" status: 202 len: 0 microversion: 2.1 time: 0.031427 Aug 30 16:07:34.689790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 436/878] 10.222.0.20 () {58 vars in 1251 bytes} [Tue Aug 30 16:07:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-247566484 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 30 16:07:34.703018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-adbf9d55-09a0-4a1f-95b0-228d012672f7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.334671 Aug 30 16:07:34.703699 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 443/879] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:07:34 2022] POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-volume_attachments => generated 194 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:35.630188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:35.630831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:35.638208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:35.638702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:35.639140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:35.639864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:35.640295 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:35.640707 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:35.727271 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lazy-loading 'services' on Instance uuid b1cdc538-a2b4-4e1d-8b87-a394851bd522 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:35.810139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-318452d0-b7c9-477a-ac6a-2f280aa21988 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522/os-volume_attachments/291d1ad7-0243-4595-878f-c8dc11f614ca" status: 202 len: 0 microversion: 2.1 time: 0.183730 Aug 30 16:07:35.810767 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 437/880] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:07:35 2022] DELETE /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522/os-volume_attachments/291d1ad7-0243-4595-878f-c8dc11f614ca => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:42.334363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:42.334979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:42.343925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.344729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.345332 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.346074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.346573 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.347149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.359698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-98b2bee4-e6da-4f38-bcb7-b13a0da64e59 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:42.366352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98b2bee4-e6da-4f38-bcb7-b13a0da64e59 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.366840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98b2bee4-e6da-4f38-bcb7-b13a0da64e59 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.367267 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-98b2bee4-e6da-4f38-bcb7-b13a0da64e59 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.389174 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:07:42.432002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-98b2bee4-e6da-4f38-bcb7-b13a0da64e59 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Going to try to stop instance {{(pid=120697) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:07:42.494747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-54da7cb1-d513-40ef-85e8-a742dca4e1e4 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "DELETE /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 204 len: 0 microversion: 2.1 time: 0.164269 Aug 30 16:07:42.495365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 444/881] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:07:42 2022] DELETE /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:07:42.503909 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-98b2bee4-e6da-4f38-bcb7-b13a0da64e59 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action" status: 202 len: 0 microversion: 2.1 time: 0.149235 Aug 30 16:07:42.505443 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:42.506511 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:42.508233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 438/882] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:07:42 2022] POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:07:42.514055 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.514544 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.514974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.515678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.516116 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.516594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.517365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:42.518279 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:42.527465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.530097 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.533826 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.534976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:42.535623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:42.536223 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:42.734756 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:42.742995 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ae8928a6-444d-4208-bd14-777c1d8cc146 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1513 microversion: 2.1 time: 0.242929 Aug 30 16:07:42.743438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 445/883] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:42 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1513 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:42.745880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:42.754727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8b048504-30be-4285-b4b5-d44cd19507c4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.244745 Aug 30 16:07:42.755412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 439/884] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:42 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:43.768027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:43.769050 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:43.777104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:43.777653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.777653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.777869 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:43.778062 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.778711 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.779188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.779645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.785495 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.786001 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.786435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.787139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:43.787586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:43.788016 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:43.978886 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:43.982569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:43.986868 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b0ea424d-ce29-4219-af52-7f7882349956 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1513 microversion: 2.1 time: 0.225349 Aug 30 16:07:43.987450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 446/885] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:43 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:43.991252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bc29960-a598-4662-a908-c3718c9bef2f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.217966 Aug 30 16:07:43.991812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 440/886] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:43 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:44.753873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-448b990f-114f-4a1f-94ed-bcbe04501399 req-d3cde461-e8d6-4cab-8cb8-461b6ac18d96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b1cdc538-a2b4-4e1d-8b87-a394851bd522", "name": "network-vif-deleted", "tag": "3690b648-84b8-4c7a-8d61-4816a4ae2a89"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:07:44.765406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-448b990f-114f-4a1f-94ed-bcbe04501399 req-d3cde461-e8d6-4cab-8cb8-461b6ac18d96 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:44.765908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-448b990f-114f-4a1f-94ed-bcbe04501399 req-d3cde461-e8d6-4cab-8cb8-461b6ac18d96 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:44.766343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-448b990f-114f-4a1f-94ed-bcbe04501399 req-d3cde461-e8d6-4cab-8cb8-461b6ac18d96 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:44.782095 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-448b990f-114f-4a1f-94ed-bcbe04501399 req-d3cde461-e8d6-4cab-8cb8-461b6ac18d96 service nova] Creating event network-vif-deleted:3690b648-84b8-4c7a-8d61-4816a4ae2a89 for instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 on hv-cinder-85505 Aug 30 16:07:44.788826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-448b990f-114f-4a1f-94ed-bcbe04501399 req-d3cde461-e8d6-4cab-8cb8-461b6ac18d96 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037669 Aug 30 16:07:44.789489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 447/887] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:07:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:07:45.008656 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:45.009246 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:45.012380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:45.013141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:45.016202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:45.016674 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:45.017107 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:45.017808 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:45.018278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:45.018677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:45.020004 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:45.020487 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:45.020912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:45.021621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:45.022070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:45.022527 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:45.051219 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:45.051713 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:45.052150 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:45.052599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lazy-loading 'fault' on Instance uuid b1cdc538-a2b4-4e1d-8b87-a394851bd522 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:07:45.120697 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '08661f6694ff44a0a4d15c792b54bb97', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ebf5f0daa032440ab81e5abda55f6e82', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:45.128965 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fb394a44-d1ea-44ee-a910-3cb0b3e1babd tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 200 len: 1308 microversion: 2.1 time: 0.124534 Aug 30 16:07:45.129683 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 441/888] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:45 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 1308 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:45.183925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:45.192246 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fc2d7520-237f-4545-98ba-a31c4c1906ca tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.184174 Aug 30 16:07:45.192791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 448/889] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:45 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:46.152198 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:46.152855 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] [instance: b1cdc538-a2b4-4e1d-8b87-a394851bd522] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:46.160418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:46.160953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:46.161478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:46.162239 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:46.162771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:46.163234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:46.180217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] HTTP exception thrown: Instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 could not be found. Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Request method failure captured: Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 HTTP/1.1 Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjVXgSzjnIqIfoJRbpLaRp9zm41-EdaysOgq3tpsm0nbYZZkVXPSp_8uzC4fSGfdIDSsVZ_govSPsLul-jkQbS6nSyMEM57PqhUECb3Cl0PpLFw1LzDau1ovT1laxeSGXmdBvmgLiEAnV4qxE6XSBfk3b7_SMeYupGRl31dgUyVKgUo Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: ebf5f0daa032440ab81e5abda55f6e82 Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1510452202 Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:07:46.181864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_ebf5f0daa032440ab81e5abda55f6e82"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-VolumesSnapshotTestJSON-1510452202 Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: ebf5f0daa032440ab81e5abda55f6e82 Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1510452202 Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-VolumesSnapshotTestJSON-1510452202-project Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 08661f6694ff44a0a4d15c792b54bb97 Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-VolumesSnapshotTestJSON-1510452202-project Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 could not be found. Aug 30 16:07:46.183529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': 'b1cdc538-a2b4-4e1d-8b87-a394851bd522'} Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 could not be found. Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:07:46.184437 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 could not be found. Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 could not be found. Aug 30 16:07:46.185762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:07:46.194466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] Returning 404 to user: Instance b1cdc538-a2b4-4e1d-8b87-a394851bd522 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:07:46.194466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-648dfa17-7d7c-4e18-94db-402e8b4ff019 tempest-VolumesSnapshotTestJSON-1510452202 tempest-VolumesSnapshotTestJSON-1510452202-project] 10.222.0.20 "GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522" status: 404 len: 111 microversion: 2.1 time: 0.035505 Aug 30 16:07:46.194466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 442/890] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:46 2022] GET /compute/v2.1/servers/b1cdc538-a2b4-4e1d-8b87-a394851bd522 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:07:46.213459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:46.214228 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:46.220937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:46.221556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:46.222044 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:46.222792 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:46.223303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:46.223780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:46.368407 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:46.379312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b5492e24-7784-4f99-ba24-37eb078d5962 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.169998 Aug 30 16:07:46.379911 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 449/891] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:46 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:47.401569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:47.402282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:47.409119 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:47.409644 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:47.410081 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:47.410775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:47.411230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:47.411656 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:47.544543 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:47.553119 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1c645b36-2de3-40d2-9602-86963b28c9d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.155639 Aug 30 16:07:47.553705 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 443/892] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:47 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:48.578111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:48.578859 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:48.587792 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:48.588420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:48.588983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:48.589928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:48.590378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:48.590777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:48.731631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:48.740611 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-22a0beac-c365-4f63-af76-e8476a9005d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.168253 Aug 30 16:07:48.741160 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 450/893] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:48 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:49.763839 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:49.764416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:49.771439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:49.771933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:49.772368 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:49.773065 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:49.773542 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:49.773968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:49.905394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:49.908915 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:49.914829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a62281c1-05f2-43c3-b357-29b2b7901771 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.155763 Aug 30 16:07:49.915399 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 444/894] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:49 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:50.936152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:50.936802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:50.943301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:50.943787 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:50.944213 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:50.944899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:50.945377 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:50.945829 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:51.086219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:51.097539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a7099334-59cc-4a43-875a-b5544576959b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.165300 Aug 30 16:07:51.098126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 451/895] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:50 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:52.120771 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:52.121497 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:52.130345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:52.130976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:52.131523 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:52.132348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:52.132884 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:52.133435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:52.273519 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:52.282625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f24bd286-25d0-4159-ba2b-cef97c3dba3c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.166728 Aug 30 16:07:52.283182 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 445/896] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:52 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:53.304208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:53.304838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:53.311908 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:53.312412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:53.312852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:53.313595 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:53.314047 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:53.314471 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:53.451284 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:53.459624 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ebb665fa-0a54-4cf3-bf25-01dd8bb4af48 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.159399 Aug 30 16:07:53.460166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 452/897] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:53 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:54.484824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:54.485561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:54.494753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:54.495355 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:54.495900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:54.496757 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:54.497353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:54.497884 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:54.629731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:54.638343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8caf5750-7f5d-4a10-891d-ff63deb163d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.159316 Aug 30 16:07:54.638923 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 446/898] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:54 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:55.659830 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:55.660453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:55.668096 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:55.668884 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:55.669357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:55.670047 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:55.670499 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:55.670917 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:55.824956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:55.828612 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:55.833955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-27cea682-eacf-4834-a700-5fd7c45b7f0b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.178113 Aug 30 16:07:55.834523 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 453/899] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:55 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:56.867652 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:56.868701 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:56.877812 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.878294 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.878731 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:56.879442 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:56.879859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:56.880318 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:57.022488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:57.031790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5f37a762-8797-41f8-8bb6-b87ca9060e10 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.170790 Aug 30 16:07:57.032382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 447/900] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:56 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:07:58.052530 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:58.053083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:58.055450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:58.062866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:58.063392 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:58.063826 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:58.064515 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:58.064957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:58.065408 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:58.199747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:58.209646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-67429d25-380b-470e-b0d6-2945a5fc2207 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.161272 Aug 30 16:07:58.210233 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 454/901] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:58 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:07:59.235993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:07:59.236963 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:07:59.240903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:07:59.250240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:59.251003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:59.251439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:59.252152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:07:59.252608 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:07:59.253033 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:07:59.391652 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:07:59.399935 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-342f4f54-a5b0-4561-a425-ef803d54f550 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.170980 Aug 30 16:07:59.400847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 448/902] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:07:59 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:00.427215 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:00.428288 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:00.439087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:00.439869 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:00.440712 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:00.441473 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:00.441920 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:00.442334 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:00.583623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:00.592242 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-567b7737-c7c1-4f6a-a86d-ed57449d48b9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.172665 Aug 30 16:08:00.592818 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 455/903] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:00 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:01.614513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:01.615091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:01.621977 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:01.622461 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:01.622895 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:01.623587 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:01.624036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:01.624458 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:01.755781 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:01.764631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-df68929f-311d-417a-af85-92156835ace6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.154255 Aug 30 16:08:01.765199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 449/904] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:01 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:02.792201 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:02.793284 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:02.804432 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.805253 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.805994 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.807118 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:02.807873 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:02.808568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:02.948023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:02.956325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-851a1473-25bd-4d5d-8527-5316f05e8bdf tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.170808 Aug 30 16:08:02.956890 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 456/905] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:02 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:03.977311 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:03.978261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:03.985081 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:03.985606 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:03.986051 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:03.986762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:03.987211 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:03.987637 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:04.120052 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:04.132075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-66d03c31-2e04-4e7c-b927-650d20619298 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1724 microversion: 2.1 time: 0.158658 Aug 30 16:08:04.132639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 450/906] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:03 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.160113 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.160717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:05.170613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:05.171100 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:05.171532 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:05.172231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:05.172681 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:05.173083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:05.312307 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:05.320942 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e39681cd-cc96-41f2-ab32-a8055cf827c0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1701 microversion: 2.1 time: 0.164608 Aug 30 16:08:05.321536 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 457/907] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1701 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:05.341450 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-af9fd16d-19f7-42c2-b2da-fe63587d3180 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:05.347740 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9fd16d-19f7-42c2-b2da-fe63587d3180 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:05.348233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9fd16d-19f7-42c2-b2da-fe63587d3180 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:05.348668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-af9fd16d-19f7-42c2-b2da-fe63587d3180 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:05.371472 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-af9fd16d-19f7-42c2-b2da-fe63587d3180 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Going to try to start instance {{(pid=120697) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:08:05.416253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-af9fd16d-19f7-42c2-b2da-fe63587d3180 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action" status: 202 len: 0 microversion: 2.1 time: 0.078668 Aug 30 16:08:05.416866 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 451/908] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:05 2022] POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:05.427035 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:05.427660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:05.433682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:05.434178 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:05.434604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:05.435286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:05.435730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:05.436148 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:05.580394 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:05.589115 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f2ad72a2-6aae-474a-995c-5fd86b32890a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1710 microversion: 2.1 time: 0.165941 Aug 30 16:08:05.589759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 458/909] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:05 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1710 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:06.611784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:06.612484 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:06.619047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:06.619537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:06.619997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:06.620685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:06.621140 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:06.621633 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:06.760236 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:06.769112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e529068a-5339-4eba-8ba3-ee64003d31b7 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1714 microversion: 2.1 time: 0.162244 Aug 30 16:08:06.769737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 452/910] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:06 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1714 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:18.363936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=9 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:18.365102 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=30 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:18.629309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c4b3b45c-50c1-4f47-9ca9-52e7db6535c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Action: 'create', calling method: .version_select at 0x7f484b91dca0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-452120714", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNW0V8KD4n4dZGtsXb/d9mBQACufruMNLEgA3p1KnZIUOUoNpcDRM6nM1LIeUm0i+6ZZkJdsG1TVdTTXWOOOxQ7CqIZdqla30bnjoeZL4k2XpxUsPWkXKotbMp15LNMtew=="}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:18.650802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-c4b3b45c-50c1-4f47-9ca9-52e7db6535c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:18.655369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-c4b3b45c-50c1-4f47-9ca9-52e7db6535c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for user 02287f232cdd4842a747bb749b483cc3 and project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'key_pairs'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:18.681822 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c4b3b45c-50c1-4f47-9ca9-52e7db6535c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.322990 Aug 30 16:08:18.682444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 459/911] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:08:18 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:34.007697 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-302476061", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-452120714", "security_groups": [{"name": "tempest-secgroup-smoke-1824698181"}], "block_device_mapping_v2": [{"uuid": "42bbc6e8-1b87-4774-8755-2c5a67e08f49", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36933f32-1926-4128-9b37-25f6ad22f3f3"}]}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:34.018831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=9 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:34.019478 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:34.134792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.network.neutron [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] validate_networks() for [('36933f32-1926-4128-9b37-25f6ad22f3f3', None, None, None, None, None)] {{(pid=120697) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:08:34.532353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Flavor limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:08:34.532774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Image limits 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:08:34.533244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Flavor pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:08:34.533700 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Image pref 0:0:0 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:08:34.534104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.virt.hardware [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120697) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:08:34.543853 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.544345 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.544780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.545539 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:34.545996 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:34.546422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:34.563360 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:08:34.567613 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for user 02287f232cdd4842a747bb749b483cc3 and project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:08:34.626108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Going to run 1 instances... {{(pid=120697) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:08:34.628254 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42bbc6e8-1b87-4774-8755-2c5a67e08f49',volume_size=None,volume_type=None)] {{(pid=120697) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:08:34.765859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8bd01491-ed26-49ae-8ff0-ec7bdc6ef7ba tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.762114 Aug 30 16:08:34.766751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 453/912] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:08:34 2022] POST /compute/v2.1/servers => generated 406 bytes in 763 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:08:34.779973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8c234ea6-e46f-4902-87ca-8811d1668cc9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:34.780604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8c234ea6-e46f-4902-87ca-8811d1668cc9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:34.783214 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=4 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:34.783821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:34.838604 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8c234ea6-e46f-4902-87ca-8811d1668cc9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:34.847567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8c234ea6-e46f-4902-87ca-8811d1668cc9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1093 microversion: 2.1 time: 0.073480 Aug 30 16:08:34.848147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 460/913] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:34 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1093 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:35.869152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:35.869723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:35.876107 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.876582 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.877014 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.877762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:35.878285 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:35.878706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:35.965266 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:35.975467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3e721a0-5036-4aa6-a554-e97a387ae148 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1199 microversion: 2.1 time: 0.110677 Aug 30 16:08:35.977489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 454/914] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:35 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1199 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:36.997700 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:36.999291 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:37.006414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.006901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.007328 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.008023 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.008502 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.008894 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.490350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:37.498814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e0092834-0621-446c-85c3-796ec60c12e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.505463 Aug 30 16:08:37.499380 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 461/915] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:36 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:37.657331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-c400f75d-bbd2-46eb-ac61-f6a4b5a42189 req-e674cf8d-a4ae-4922-a538-590d4c7779a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0807429c-12cc-47c7-94a0-6e08488776a0", "tag": "b9e43e96-a64c-4bce-8e0b-7ee294ced831"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:37.667933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c400f75d-bbd2-46eb-ac61-f6a4b5a42189 req-e674cf8d-a4ae-4922-a538-590d4c7779a9 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:37.668769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c400f75d-bbd2-46eb-ac61-f6a4b5a42189 req-e674cf8d-a4ae-4922-a538-590d4c7779a9 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:37.669323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-c400f75d-bbd2-46eb-ac61-f6a4b5a42189 req-e674cf8d-a4ae-4922-a538-590d4c7779a9 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:37.681636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-c400f75d-bbd2-46eb-ac61-f6a4b5a42189 req-e674cf8d-a4ae-4922-a538-590d4c7779a9 service nova] Creating event network-changed:b9e43e96-a64c-4bce-8e0b-7ee294ced831 for instance 0807429c-12cc-47c7-94a0-6e08488776a0 on hv-cinder-85505 Aug 30 16:08:37.687115 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-c400f75d-bbd2-46eb-ac61-f6a4b5a42189 req-e674cf8d-a4ae-4922-a538-590d4c7779a9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033552 Aug 30 16:08:37.687685 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 455/916] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:38.519968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:38.520575 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:38.528785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.529259 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.530009 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.530714 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:38.531226 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:38.531774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:38.746561 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:38.754990 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fbe5fa03-e81c-4224-b64e-cce61a05ac1a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.239078 Aug 30 16:08:38.755682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 462/917] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:38 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:39.782901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:39.783947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:39.794515 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.795315 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.796033 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.797173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:39.797928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:39.798418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:39.936749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:39.944990 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2cee2279-0ef2-45a7-8823-0e364a28c315 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.170118 Aug 30 16:08:39.945686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 456/918] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:39 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:40.965157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:40.965791 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:40.972443 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.972916 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.973392 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:40.974094 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:40.974591 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:40.974927 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:41.107978 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:41.117392 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-14943bb8-a6ae-4f8c-b985-d715ded9aabb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.156096 Aug 30 16:08:41.117975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 463/919] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:40 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:42.142027 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:42.143063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:42.154405 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.155198 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.155924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.157073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.157818 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.158243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.304108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:42.315742 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-9c6ec8d3-eb4a-41d7-9267-da8aa268da7b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.180653 Aug 30 16:08:42.316352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 457/920] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:42 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:42.569899 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:42.570739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:42.580936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.581465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.581901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.582594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:42.583045 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:42.583463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:42.666688 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lazy-loading 'services' on Instance uuid 2c12da29-7487-4964-af58-1bc74336173a {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:08:42.742799 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ebb59232-76d4-4401-a0e6-971fd1d145a3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-volume_attachments/cade0bbf-76b5-4605-a0c3-0f3600c33c0d" status: 202 len: 0 microversion: 2.1 time: 0.179804 Aug 30 16:08:42.743415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 464/921] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:08:42 2022] DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-volume_attachments/cade0bbf-76b5-4605-a0c3-0f3600c33c0d => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:43.335842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:43.336449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:43.343099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:43.343589 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:43.344025 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:43.344722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:43.345197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:43.345635 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:43.482110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:43.490801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f15ce4b2-0b2f-4f60-9733-5ec3a4f568be tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.158759 Aug 30 16:08:43.491372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 458/922] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:43 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:43.866400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-52e12beb-6b10-42f6-a461-f91c95fb3371 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:43.873197 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52e12beb-6b10-42f6-a461-f91c95fb3371 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:43.873699 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52e12beb-6b10-42f6-a461-f91c95fb3371 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:43.874132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-52e12beb-6b10-42f6-a461-f91c95fb3371 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:43.933578 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-52e12beb-6b10-42f6-a461-f91c95fb3371 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Going to try to stop instance {{(pid=120696) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Aug 30 16:08:43.983797 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-52e12beb-6b10-42f6-a461-f91c95fb3371 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action" status: 202 len: 0 microversion: 2.1 time: 0.122114 Aug 30 16:08:43.984406 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 465/923] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:43 2022] POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:43.992840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:43.993481 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:43.999486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:43.999979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.000398 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.001104 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.001577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.001993 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.131028 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:44.141361 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-77fc16f1-7170-4acb-9fa0-bbbe6e2c4f3f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.152554 Aug 30 16:08:44.142094 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 459/924] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:43 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:44.516521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:44.517772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:44.528413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.529208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.529977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.531111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:44.531864 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:44.532648 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:44.682928 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:44.690896 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-378044ac-5732-4a04-b3dd-19ffcffa7b35 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.181650 Aug 30 16:08:44.691452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 466/925] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:44 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:45.163507 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:45.164151 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:45.166791 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:45.167503 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:45.173003 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.173505 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.173935 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.174630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.175071 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.175489 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.308628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:45.317031 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ace6860d-715b-47d8-8b2c-ceb4d4bb1fd8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.157690 Aug 30 16:08:45.317636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 460/926] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:45 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:45.715605 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:45.716559 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:45.719783 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:45.729904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.730697 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.731404 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.732518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:45.733314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:45.733983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:45.869210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:45.877748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-21903ef7-05e7-435f-806a-55337fc16ef7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.168625 Aug 30 16:08:45.878326 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 467/927] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:45 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:46.341944 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:46.342931 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:46.353366 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:46.354110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:46.354759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:46.355807 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:46.356507 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:46.357152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:46.494798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:46.502875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-b077aad1-5fc2-47f0-bff6-2d2a9784ea33 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.167300 Aug 30 16:08:46.503453 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 461/928] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:46 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:46.902397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:46.903344 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:46.911950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:46.912691 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:46.913162 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:46.914266 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:46.914360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:46.914739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:47.053137 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:47.061465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-19e87ba4-36cf-4529-a3d1-fb2646acbb53 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.165426 Aug 30 16:08:47.062071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 468/929] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:46 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:47.528185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:47.529115 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:47.536926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:47.537476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:47.537905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:47.538594 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:47.539040 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:47.539463 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:47.677429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:47.685227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e92e1f97-23b1-488c-855d-ca845f62457a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.163831 Aug 30 16:08:47.685917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 462/930] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:47 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:48.086486 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:48.087428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:48.097608 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:48.098114 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:48.098518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:48.099196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:48.099643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:48.100034 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:48.249253 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:48.258575 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fee92f06-4b90-4981-900e-bcf2c0c325e5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.178603 Aug 30 16:08:48.259127 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 469/931] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:48 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:48.706727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:48.707286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:48.714160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:48.714641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:48.715064 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:48.715743 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:48.716188 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:48.716603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:48.855727 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:48.865210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-351e8692-7b2d-4f1a-921e-103e456d90f6 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.162085 Aug 30 16:08:48.866204 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 463/932] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:48 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:49.109007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3ac2a355-618b-4efc-bfe5-6d55cd9a685a req-6e759865-ee97-4687-85d8-b8c63bb763dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0807429c-12cc-47c7-94a0-6e08488776a0", "name": "network-vif-plugged", "status": "completed", "tag": "b9e43e96-a64c-4bce-8e0b-7ee294ced831"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:49.119957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ac2a355-618b-4efc-bfe5-6d55cd9a685a req-6e759865-ee97-4687-85d8-b8c63bb763dc service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.120442 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ac2a355-618b-4efc-bfe5-6d55cd9a685a req-6e759865-ee97-4687-85d8-b8c63bb763dc service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.120934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ac2a355-618b-4efc-bfe5-6d55cd9a685a req-6e759865-ee97-4687-85d8-b8c63bb763dc service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:49.133083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3ac2a355-618b-4efc-bfe5-6d55cd9a685a req-6e759865-ee97-4687-85d8-b8c63bb763dc service nova] Creating event network-vif-plugged:b9e43e96-a64c-4bce-8e0b-7ee294ced831 for instance 0807429c-12cc-47c7-94a0-6e08488776a0 on hv-cinder-85505 Aug 30 16:08:49.138286 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3ac2a355-618b-4efc-bfe5-6d55cd9a685a req-6e759865-ee97-4687-85d8-b8c63bb763dc service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033068 Aug 30 16:08:49.138955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 470/933] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:49.287096 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:49.287611 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:49.294982 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.295473 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.295897 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:49.296615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.297065 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.297518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:49.462749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:49.470867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-bc4a9903-ac47-4bc5-8f28-7469d6418980 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.188505 Aug 30 16:08:49.471521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 464/934] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:49 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:49.895478 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:49.896264 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:49.904184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.904660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.905078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:49.905798 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:49.906240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:49.906649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.041527 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:50.049402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51bfcb16-c6f4-4372-ad0e-35940dbf4066 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.160846 Aug 30 16:08:50.050070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 471/935] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:49 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:50.493930 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:50.494537 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:50.503632 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.504111 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.504541 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.505250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:50.505697 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:50.506118 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:50.638388 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:50.647039 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5c3db486-67bf-4e19-b096-5237a10d03c4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1265 microversion: 2.1 time: 0.158414 Aug 30 16:08:50.647039 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 465/936] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:50 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:51.070872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:51.071525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:51.078202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:51.078713 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:51.079099 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:51.079878 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:51.080283 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:51.080694 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:51.213186 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:51.220974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4ab537ad-6f42-4271-a05f-6170f7acf966 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.154058 Aug 30 16:08:51.221533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 472/937] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:51 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:51.667391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:51.668024 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:51.675021 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:51.675576 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:51.676060 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:51.676800 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:51.677343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:51.677803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:51.814722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:51.823243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-dd132690-710d-4ffb-97e4-3e0fa57b5c27 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1452 microversion: 2.1 time: 0.159832 Aug 30 16:08:51.823820 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 466/938] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:51 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1452 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:51.846967 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:51.847580 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:51.854445 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:51.854929 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:51.855363 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:51.856053 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:51.856500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:51.856919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:52.002149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:52.010235 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-241fd033-c9a9-4c31-91fc-660b70b4fa25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1452 microversion: 2.1 time: 0.170514 Aug 30 16:08:52.010839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 473/939] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:51 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1452 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:52.242630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:52.243264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:52.249834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:52.250352 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:52.250775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:52.251498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:52.251917 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:52.252349 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:52.383260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:52.391386 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd608524-1d8c-4115-a908-5f3659d66eb9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.152753 Aug 30 16:08:52.391928 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 467/940] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:52 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:53.413834 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:53.414443 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:53.421104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:53.421631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:53.422064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:53.422758 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:53.423208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:53.423623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:53.565526 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:53.573708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-da1373b7-d4ce-475f-b16f-ac083173a65b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1678 microversion: 2.1 time: 0.163838 Aug 30 16:08:53.574249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 474/941] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:53 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1678 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:53.758053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-8d4b0951-ee53-4edb-95c2-cdc6d5e05f92 req-b792147e-288d-4e1a-bffa-22101a2ee159 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0807429c-12cc-47c7-94a0-6e08488776a0", "tag": "b9e43e96-a64c-4bce-8e0b-7ee294ced831"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:53.768901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8d4b0951-ee53-4edb-95c2-cdc6d5e05f92 req-b792147e-288d-4e1a-bffa-22101a2ee159 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:53.769630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8d4b0951-ee53-4edb-95c2-cdc6d5e05f92 req-b792147e-288d-4e1a-bffa-22101a2ee159 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:53.770064 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-8d4b0951-ee53-4edb-95c2-cdc6d5e05f92 req-b792147e-288d-4e1a-bffa-22101a2ee159 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:53.781620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-8d4b0951-ee53-4edb-95c2-cdc6d5e05f92 req-b792147e-288d-4e1a-bffa-22101a2ee159 service nova] Creating event network-changed:b9e43e96-a64c-4bce-8e0b-7ee294ced831 for instance 0807429c-12cc-47c7-94a0-6e08488776a0 on hv-cinder-85505 Aug 30 16:08:53.786770 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-8d4b0951-ee53-4edb-95c2-cdc6d5e05f92 req-b792147e-288d-4e1a-bffa-22101a2ee159 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032457 Aug 30 16:08:53.787376 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 468/942] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:08:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:08:54.595278 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:54.595934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:54.603220 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.603866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.604325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.605030 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.605708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.606116 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.743857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:54.752814 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2fb1e609-2fac-4828-a3cb-1c59d0049a93 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1655 microversion: 2.1 time: 0.161484 Aug 30 16:08:54.753565 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 475/943] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:54 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1655 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:54.774610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-707202fb-99dd-4617-9177-3f21b2be7ff0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:08:54.780954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707202fb-99dd-4617-9177-3f21b2be7ff0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.781493 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707202fb-99dd-4617-9177-3f21b2be7ff0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.781980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-707202fb-99dd-4617-9177-3f21b2be7ff0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.804299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-707202fb-99dd-4617-9177-3f21b2be7ff0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Going to try to start instance {{(pid=120697) start /opt/stack/nova/nova/compute/api.py:2785}} Aug 30 16:08:54.849108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-707202fb-99dd-4617-9177-3f21b2be7ff0 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action" status: 202 len: 0 microversion: 2.1 time: 0.079328 Aug 30 16:08:54.849780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 469/944] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:08:54 2022] POST /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:08:54.858716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:54.859325 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:54.865379 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.865881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.866309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.867018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:54.867463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:54.868069 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:54.890303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:55.042232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:55.050742 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2480244f-f7f4-47b9-ba1b-1406e9d93fe2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1664 microversion: 2.1 time: 0.196107 Aug 30 16:08:55.051320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 476/945] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:54 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1664 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:56.078247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:56.079291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:56.089785 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:56.090581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:56.091302 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:56.092436 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:56.093197 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:56.093946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:56.113849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:08:56.230818 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:56.238883 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30575280-243e-47f0-8e34-532fec30cbbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1664 microversion: 2.1 time: 0.168744 Aug 30 16:08:56.239476 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 470/946] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:56 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1664 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:08:57.264230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:08:57.265196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:08:57.273522 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:57.274002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:57.274425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:57.275102 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:08:57.275556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:08:57.275968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:08:57.561449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:08:57.571056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f27ca0fe-5689-4c23-b638-ceaa88e21145 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1668 microversion: 2.1 time: 0.313447 Aug 30 16:08:57.571658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 477/947] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:08:57 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1668 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:30.049110 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:30.052229 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:30.055588 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:30.056331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:30.064221 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.064728 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.065166 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.065893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.066348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.066777 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.097508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4058fbb4-f2a2-4d7a-ad2f-ed9946d0f2d9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054802 Aug 30 16:09:30.098063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 471/948] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:09:30 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:09:30.160816 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:30.161374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:30.163621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=38 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:30.164274 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=8 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:30.170716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.171204 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.171632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.172317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.172762 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.173179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.198766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:09:30.279566 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bbbd1dfa-4a08-4ccc-a2b2-18e0ffb1b4fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 204 len: 0 microversion: 2.1 time: 0.122333 Aug 30 16:09:30.280200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 478/949] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:09:30 2022] DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:09:30.288518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:30.289199 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:30.295216 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.295768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.296193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.296867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:30.297347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:30.297762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:30.494430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:30.502433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad0bb7ab-66f4-4fd5-b438-5b17aacc0df9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1674 microversion: 2.1 time: 0.217869 Aug 30 16:09:30.503115 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 472/950] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:30 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1674 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:31.529037 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:31.530243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:31.538140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.538619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.539052 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.539735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:31.540183 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:31.540597 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:31.729025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:31.741881 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-13e371b1-0df4-4e9b-8e74-1d5361c53908 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1674 microversion: 2.1 time: 0.219714 Aug 30 16:09:31.742485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 479/951] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:31 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1674 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:32.765556 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:32.766162 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:32.772529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.773012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.773471 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.774183 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:32.774603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:32.775024 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:32.962900 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:32.974451 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-32a09b95-8c4c-4646-9ba7-e6081b9ec792 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 200 len: 1674 microversion: 2.1 time: 0.214915 Aug 30 16:09:32.975036 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 473/952] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:32 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 1674 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:33.315104 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-caa698af-38fc-4523-96de-0985daf2f3af req-b4c87122-a36c-4b38-9b2d-7822288e77c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c12da29-7487-4964-af58-1bc74336173a", "name": "network-vif-deleted", "tag": "409e10a7-7f54-4da1-949a-6464aba37e15"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:33.332436 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-caa698af-38fc-4523-96de-0985daf2f3af req-b4c87122-a36c-4b38-9b2d-7822288e77c4 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:33.333200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-caa698af-38fc-4523-96de-0985daf2f3af req-b4c87122-a36c-4b38-9b2d-7822288e77c4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:33.333835 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-caa698af-38fc-4523-96de-0985daf2f3af req-b4c87122-a36c-4b38-9b2d-7822288e77c4 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:33.356029 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-caa698af-38fc-4523-96de-0985daf2f3af req-b4c87122-a36c-4b38-9b2d-7822288e77c4 service nova] Creating event network-vif-deleted:409e10a7-7f54-4da1-949a-6464aba37e15 for instance 2c12da29-7487-4964-af58-1bc74336173a on hv-cinder-85505 Aug 30 16:09:33.361754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-caa698af-38fc-4523-96de-0985daf2f3af req-b4c87122-a36c-4b38-9b2d-7822288e77c4 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050342 Aug 30 16:09:33.362661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 480/953] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:33.995792 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:33.996412 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:34.003974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.004490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.005288 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.006182 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:34.006777 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:34.007264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:34.028093 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] HTTP exception thrown: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Request method failure captured: Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a HTTP/1.1 Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjWFlqPdueO-8IRgp9rNQ2v-hffuVdHQEbktH1U3i38lPV32p9y5kPNn0qc2GflSCBJy_VhFMx4T5rwZJeMOdqZXowlZ4hFQdj6WMffRc0mqVofMc2iB3ynh-fdUnCZoHZydAS_TnznTIWJIouVk7VU5ZknRe6QtkAdlNvG-RnJD-Tk Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:09:34.031153 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 1cd3f1cbe0eb496f8e4c0692366fdefb Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:09:34.032722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '2c12da29-7487-4964-af58-1bc74336173a'} Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:09:34.033873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:09:34.039649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:09:34.042456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Returning 404 to user: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:09:34.042456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-637c0ab0-1d1f-4373-bcb3-97bdc70da2de tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 404 len: 111 microversion: 2.1 time: 0.041714 Aug 30 16:09:34.042456 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 474/954] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:33 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:09:34.050322 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c2cc3c94-8101-4964-ae87-ee55f553f9f2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '.version_select at 0x7f484b8e2af0>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:34.074130 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c2cc3c94-8101-4964-ae87-ee55f553f9f2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836700732" status: 202 len: 0 microversion: 2.1 time: 0.032590 Aug 30 16:09:34.074764 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 481/955] 10.222.0.20 () {58 vars in 1221 bytes} [Tue Aug 30 16:09:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1836700732 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:09:34.726555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4b2f78e7-7137-4f23-a62c-f9e03f6a07d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: .version_select at 0x7f4848080280>, body: {"keypair": {"name": "tempest-keypair-381933107", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLs/aPzhgyadZ5fy0qsqgscDXAsNx/6zmdFvecn2+JCbYVQvAI2J7/qJOXBJGoXvZlictw7YAu7GVxPEd4z3qOOC5NFtLAMEt8QXf9B/Wz+0e44pSa1yypqUQ/mUIwO4QQ=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:34.743094 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-4b2f78e7-7137-4f23-a62c-f9e03f6a07d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:34.746932 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-4b2f78e7-7137-4f23-a62c-f9e03f6a07d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for user 1cd3f1cbe0eb496f8e4c0692366fdefb and project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:34.772018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4b2f78e7-7137-4f23-a62c-f9e03f6a07d8 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.049889 Aug 30 16:09:34.772864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 475/956] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:09:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:36.350744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:09:36.351249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Tue Aug 30 16:09:36 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Aug 30 16:09:36.355841 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1127903709", "imageRef": "74a60e9b-8752-4180-929d-575831bc219d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "81d1bc24-854e-40b0-bd62-d7bb6921d20e"}], "security_groups": [{"name": "tempest-securitygroup--1440576850"}], "key_name": "tempest-keypair-381933107", "user_data": "}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:36.462716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] validate_networks() for [('81d1bc24-854e-40b0-bd62-d7bb6921d20e', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:09:36.864912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:09:36.865663 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:09:36.866360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:09:36.866997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:09:36.867636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:09:36.882349 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.883101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.883800 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.885018 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:36.885693 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:36.886241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:36.906114 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:09:36.910514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Getting quotas for user 1cd3f1cbe0eb496f8e4c0692366fdefb and project 12d8ded5bfda4c8ebb281a5504b56eb1. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:09:36.922210 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:09:36.924609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='74a60e9b-8752-4180-929d-575831bc219d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:09:36.978531 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ac812a5e-1009-4e7c-801e-d2361e35107d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.629624 Aug 30 16:09:36.979230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 482/957] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:09:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 631 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:09:36.990962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5f4317bc-2a54-48b3-a8bb-31379dcd45a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:36.991591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5f4317bc-2a54-48b3-a8bb-31379dcd45a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:37.049423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5f4317bc-2a54-48b3-a8bb-31379dcd45a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:37.056490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5f4317bc-2a54-48b3-a8bb-31379dcd45a9 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1237 microversion: 2.1 time: 0.070098 Aug 30 16:09:37.057063 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 476/958] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:36 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1237 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:38.078806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:38.079385 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:38.085904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.086402 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.086819 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.087510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:38.087961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:38.088378 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:38.189649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:38.198330 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-875c7c1b-e041-4320-b001-c3256db235c5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1297 microversion: 2.1 time: 0.124807 Aug 30 16:09:38.198986 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 483/959] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:38 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1297 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.220094 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:39.220903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:39.228231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.228722 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.229154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.229896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.230348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.230774 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.443301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:39.451625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3c539574-fd97-4881-b7c1-590eaf44bd5a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.235697 Aug 30 16:09:39.452209 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 477/960] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:39 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:39.671143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-fcc52191-1ed0-4c15-bb8e-fd43ed6b5ec9 req-a3a9a7dd-6fdd-4060-961d-0ebc7470dcc5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8246872b-3fac-4df8-961a-703e059990b0", "tag": "35c7dd88-f016-4de9-9319-02217d847571"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:39.682277 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fcc52191-1ed0-4c15-bb8e-fd43ed6b5ec9 req-a3a9a7dd-6fdd-4060-961d-0ebc7470dcc5 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:39.683268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fcc52191-1ed0-4c15-bb8e-fd43ed6b5ec9 req-a3a9a7dd-6fdd-4060-961d-0ebc7470dcc5 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:39.683852 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-fcc52191-1ed0-4c15-bb8e-fd43ed6b5ec9 req-a3a9a7dd-6fdd-4060-961d-0ebc7470dcc5 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:39.695236 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-fcc52191-1ed0-4c15-bb8e-fd43ed6b5ec9 req-a3a9a7dd-6fdd-4060-961d-0ebc7470dcc5 service nova] Creating event network-changed:35c7dd88-f016-4de9-9319-02217d847571 for instance 8246872b-3fac-4df8-961a-703e059990b0 on hv-cinder-85505 Aug 30 16:09:39.700198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-fcc52191-1ed0-4c15-bb8e-fd43ed6b5ec9 req-a3a9a7dd-6fdd-4060-961d-0ebc7470dcc5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033514 Aug 30 16:09:39.700712 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 484/961] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:40.472460 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:40.473037 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:40.480567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.481054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.481535 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.482236 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:40.482801 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:40.484043 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:40.622790 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:40.631803 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-5bde5fa4-6063-4be5-9734-ac71ff1140fb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.163276 Aug 30 16:09:40.632463 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 478/962] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:40 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:41.659111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:41.659955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:41.667150 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.667642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.668067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.668766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:41.669208 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:41.669671 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:41.813508 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:41.825164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e45168a2-5462-478e-9e3d-d616019a0f2b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.175663 Aug 30 16:09:41.825910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 485/963] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:41 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:42.850648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:42.851240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:42.858643 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.859155 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.859642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.860377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:42.860885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:42.861362 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:42.988308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:42.996553 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-09a2dc9d-10f4-470d-9715-8073f1dbbcd5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.151297 Aug 30 16:09:42.997126 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 479/964] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:42 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:44.020901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:44.021586 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:44.029204 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.029843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.030327 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.031106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:44.031635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:44.032107 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:44.173844 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:44.182957 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-44c9d231-53ac-42a6-9e40-61ebc2ce5af2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.167892 Aug 30 16:09:44.183518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 486/965] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:44 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:45.206372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:45.206994 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:45.216861 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.217502 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.218085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.219062 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.219651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.220243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.321939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-12b87896-3922-4bdf-9583-90158dd2963f req-7997e3d7-b051-42e3-9033-d7d211dcadc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8246872b-3fac-4df8-961a-703e059990b0", "name": "network-vif-plugged", "status": "completed", "tag": "35c7dd88-f016-4de9-9319-02217d847571"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:45.332547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-12b87896-3922-4bdf-9583-90158dd2963f req-7997e3d7-b051-42e3-9033-d7d211dcadc8 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:45.333058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-12b87896-3922-4bdf-9583-90158dd2963f req-7997e3d7-b051-42e3-9033-d7d211dcadc8 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:45.333498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-12b87896-3922-4bdf-9583-90158dd2963f req-7997e3d7-b051-42e3-9033-d7d211dcadc8 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:45.344683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-12b87896-3922-4bdf-9583-90158dd2963f req-7997e3d7-b051-42e3-9033-d7d211dcadc8 service nova] Creating event network-vif-plugged:35c7dd88-f016-4de9-9319-02217d847571 for instance 8246872b-3fac-4df8-961a-703e059990b0 on hv-cinder-85505 Aug 30 16:09:45.349465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-12b87896-3922-4bdf-9583-90158dd2963f req-7997e3d7-b051-42e3-9033-d7d211dcadc8 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031363 Aug 30 16:09:45.350739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 487/966] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:45.361058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:45.368811 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8beecc88-0e52-4b3d-8367-67ff7cc257e3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.168380 Aug 30 16:09:45.369416 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 480/967] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:45 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:46.401802 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:46.402569 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:46.409970 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.410494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.410971 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.411729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:46.412224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:46.412716 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:46.551400 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:46.559735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-fa72e6c1-190b-4364-8194-b8d467cb5dad tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1363 microversion: 2.1 time: 0.164580 Aug 30 16:09:46.560301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 488/968] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:46 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1363 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.584466 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.585762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.589397 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:47.598598 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.599392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.600488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.601660 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.602391 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.602809 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.734280 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:09:47.742648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-fa798014-0074-45dd-a2fc-b37cf059d4d4 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1548 microversion: 2.1 time: 0.165024 Aug 30 16:09:47.743230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 481/969] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1548 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:09:47.762488 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:09:47.762975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:09:47.764918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:47.765609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:09:47.771737 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.772211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.772632 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.773342 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:47.773868 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:47.774285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:47.858773 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a6ac8ea8-c7df-4677-a61d-2f5c585f437a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099803 Aug 30 16:09:47.859520 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 489/970] 10.222.0.20 () {58 vars in 1275 bytes} [Tue Aug 30 16:09:47 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:09:49.075677 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-de58ce35-4aa9-4bc9-bd35-041c06555f56 req-31531e7b-6644-4a7f-8646-69a37f7bc084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8246872b-3fac-4df8-961a-703e059990b0", "tag": "35c7dd88-f016-4de9-9319-02217d847571"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:09:49.086035 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de58ce35-4aa9-4bc9-bd35-041c06555f56 req-31531e7b-6644-4a7f-8646-69a37f7bc084 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:09:49.086577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de58ce35-4aa9-4bc9-bd35-041c06555f56 req-31531e7b-6644-4a7f-8646-69a37f7bc084 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:09:49.086990 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-de58ce35-4aa9-4bc9-bd35-041c06555f56 req-31531e7b-6644-4a7f-8646-69a37f7bc084 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:09:49.098725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-de58ce35-4aa9-4bc9-bd35-041c06555f56 req-31531e7b-6644-4a7f-8646-69a37f7bc084 service nova] Creating event network-changed:35c7dd88-f016-4de9-9319-02217d847571 for instance 8246872b-3fac-4df8-961a-703e059990b0 on hv-cinder-85505 Aug 30 16:09:49.104293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-de58ce35-4aa9-4bc9-bd35-041c06555f56 req-31531e7b-6644-4a7f-8646-69a37f7bc084 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032367 Aug 30 16:09:49.105040 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 482/971] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:09:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:25.326300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:25.327387 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:25.333171 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:25.333857 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:25.343645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.344030 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.344490 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.345182 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:25.345668 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:25.346142 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:25.372179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b79c4d4b-3a82-4886-a274-2432636a53e5 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/ips" status: 200 len: 145 microversion: 2.1 time: 0.047908 Aug 30 16:10:25.372766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 490/972] 10.222.0.20 () {58 vars in 1248 bytes} [Tue Aug 30 16:10:25 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/ips => generated 145 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:26.724370 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:26.725363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=52 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:26.732168 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "074f9f67-ab52-4216-bb66-71afce5e19a6"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:26.735251 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:26.742805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:26.743281 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:26.743706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:26.744390 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:26.744838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:26.745274 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:27.028528 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54ee62bc-2eae-4cfd-9b94-cee13c00b877 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307023 Aug 30 16:10:27.029149 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 483/973] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:10:26 2022] POST /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:34.630261 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:34.632548 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:34.638914 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.639391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.639817 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.640534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.640997 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.641453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.671401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8c9fd5af-9adc-40ef-9b84-afa36447b817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045363 Aug 30 16:10:34.671943 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 491/974] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:10:34 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:34.683871 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:34.684401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:34.691118 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.691625 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.692044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.692736 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:34.693187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:34.693651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:34.722264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-58b75e03-86b3-43a2-a106-c8bb7bb5f827 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/074f9f67-ab52-4216-bb66-71afce5e19a6" status: 200 len: 194 microversion: 2.1 time: 0.043262 Aug 30 16:10:34.722838 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 484/975] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 30 16:10:34 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/074f9f67-ab52-4216-bb66-71afce5e19a6 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:36.071029 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96ab8622-9c2e-4c1e-b39a-f2b3669dd5fa"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:36.073496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:36.080494 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.080981 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.081459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.082150 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:36.082658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:36.083083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:36.372021 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-32196025-ab25-4ffb-8ede-58971a66bf54 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "POST /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.304896 Aug 30 16:10:36.372650 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 492/976] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:10:36 2022] POST /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments => generated 194 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:43.938124 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:43.940413 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:43.948583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.949371 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.950167 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.952167 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:43.955306 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:43.956114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:43.996301 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-808b7921-b135-4840-8a01-2108d082f4cc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.062368 Aug 30 16:10:43.997054 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 485/977] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:10:43 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments => generated 371 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:44.152122 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.152948 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.163805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.164304 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.164733 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.165468 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.165919 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.166340 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.196383 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2ff02291-927c-4df3-aa2d-8f11b7228ebc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/074f9f67-ab52-4216-bb66-71afce5e19a6" status: 200 len: 194 microversion: 2.1 time: 0.051594 Aug 30 16:10:44.196980 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 493/978] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 30 16:10:44 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/074f9f67-ab52-4216-bb66-71afce5e19a6 => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:44.210924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:44.211630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:44.222332 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.223075 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.223978 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.225058 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:44.225534 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:44.225953 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:44.316446 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lazy-loading 'services' on Instance uuid 8246872b-3fac-4df8-961a-703e059990b0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:44.404539 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0bdf6e2d-68bd-4c59-8f4a-9eb2afd7a8af tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/074f9f67-ab52-4216-bb66-71afce5e19a6" status: 202 len: 0 microversion: 2.1 time: 0.200053 Aug 30 16:10:44.405259 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 486/979] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:10:44 2022] DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/074f9f67-ab52-4216-bb66-71afce5e19a6 => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:10:45.531772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:45.532368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:45.539039 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.539518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.540623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.541068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.541515 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.573064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4b493fa0-abbf-45f4-b385-1d400e5ffa12 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/96ab8622-9c2e-4c1e-b39a-f2b3669dd5fa" status: 200 len: 194 microversion: 2.1 time: 0.045593 Aug 30 16:10:45.573646 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 494/980] 10.222.0.20 () {58 vars in 1413 bytes} [Tue Aug 30 16:10:45 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/96ab8622-9c2e-4c1e-b39a-f2b3669dd5fa => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:45.585357 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:45.585936 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:45.592426 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.592911 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.593380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.594073 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:45.594521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:45.594941 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:45.687017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lazy-loading 'services' on Instance uuid 8246872b-3fac-4df8-961a-703e059990b0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:45.766163 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ff27f713-2b6d-41f1-aee7-3106cc8118f3 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/96ab8622-9c2e-4c1e-b39a-f2b3669dd5fa" status: 202 len: 0 microversion: 2.1 time: 0.185431 Aug 30 16:10:45.766776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 487/981] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:10:45 2022] DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments/96ab8622-9c2e-4c1e-b39a-f2b3669dd5fa => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:10:46.947464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:46.949794 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:46.956895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.957425 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.957855 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.958555 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:46.959000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:46.959419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:46.995281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-77d73ca0-8c18-4ca9-a4b9-cc6ea227dcf2 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051946 Aug 30 16:10:46.995842 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 495/982] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:10:46 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:10:47.111890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:47.114166 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:47.120972 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.121485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.121912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.122592 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.123038 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.123448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.152980 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-d3008164-422f-48f8-9b0f-b8938adfde8a tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046064 Aug 30 16:10:47.153550 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 488/983] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:10:47 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:10:47.218858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:47.219343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:47.226155 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.226640 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.227067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.227785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.228234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.228649 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.253652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Going to try to terminate instance {{(pid=120696) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:10:47.336856 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-4831ff20-b4d7-4418-bf08-bd910c72bc06 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 204 len: 0 microversion: 2.1 time: 0.121416 Aug 30 16:10:47.337599 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 496/984] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:47 2022] DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:10:47.346517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:47.347055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:47.353650 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.354135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.354573 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.355257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:47.355705 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:47.356126 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:47.492296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:47.500389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4fbd5f9d-f19c-4aca-b388-cd89d3896c8e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1673 microversion: 2.1 time: 0.158015 Aug 30 16:10:47.500964 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 489/985] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:47 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:48.526724 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:48.527880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:48.538563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.539353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.540059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.541187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.541921 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.542336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.691465 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:48.700623 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f389d5a4-e742-4433-b365-f97cb07100fc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1673 microversion: 2.1 time: 0.181025 Aug 30 16:10:48.701184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 497/986] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:48 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:48.713496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:48.713496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:48.713496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.713496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.714581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.714581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.714581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.714581 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.737842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:10:48.818272 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-8f4d3acd-d0c4-49c3-9efe-9dde2476b0fa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 204 len: 0 microversion: 2.1 time: 0.119409 Aug 30 16:10:48.819106 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 490/987] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:48 2022] DELETE /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 30 16:10:48.828414 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:48.829017 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:48.835202 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.835669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.836089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.836746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:48.837198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:48.837634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:48.989211 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:48.997766 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bb0740eb-1a1a-429f-8875-426ae60b49f4 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1576 microversion: 2.1 time: 0.173357 Aug 30 16:10:48.998336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 498/988] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:48 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1576 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:49.727555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:49.728974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:49.740076 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.740920 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.741824 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.742964 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:49.743720 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:49.744480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:49.892968 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:49.901297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a7c61d80-8b21-48cb-86ce-04592d9845bb tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1673 microversion: 2.1 time: 0.181171 Aug 30 16:10:49.901793 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 491/989] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:49 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1673 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:50.024109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:50.025077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:50.035958 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.036760 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.037502 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.038621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.039357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.040085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.178680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:50.186871 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-89abd012-6463-4d76-b8d1-8f9dceafd6bf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1576 microversion: 2.1 time: 0.170523 Aug 30 16:10:50.187448 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 499/990] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:50 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:50.922753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:50.923354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:50.930411 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.930907 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.931348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:50.932147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:50.932578 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:50.933203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.208854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:51.210159 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:51.216771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.217534 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.218154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.218853 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.219282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.219882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.317759 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.327000 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-36df24aa-7097-4afe-88b6-8a522831bca2 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1508 microversion: 2.1 time: 0.122785 Aug 30 16:10:51.341126 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 500/991] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:51 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1508 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:51.345646 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:51.354363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f598deee-b92d-4509-904a-284d7723e48f tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1673 microversion: 2.1 time: 0.435471 Aug 30 16:10:51.355408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 492/992] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:50 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1673 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:51.418087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-f7428857-57a1-4a01-bcc2-9a35fafbe222 req-addd1163-0ac2-451b-932f-d00c3159cc4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0807429c-12cc-47c7-94a0-6e08488776a0", "name": "network-vif-deleted", "tag": "b9e43e96-a64c-4bce-8e0b-7ee294ced831"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:51.428588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f7428857-57a1-4a01-bcc2-9a35fafbe222 req-addd1163-0ac2-451b-932f-d00c3159cc4d service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.429735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f7428857-57a1-4a01-bcc2-9a35fafbe222 req-addd1163-0ac2-451b-932f-d00c3159cc4d service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.430682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-f7428857-57a1-4a01-bcc2-9a35fafbe222 req-addd1163-0ac2-451b-932f-d00c3159cc4d service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.444200 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-f7428857-57a1-4a01-bcc2-9a35fafbe222 req-addd1163-0ac2-451b-932f-d00c3159cc4d service nova] Creating event network-vif-deleted:b9e43e96-a64c-4bce-8e0b-7ee294ced831 for instance 0807429c-12cc-47c7-94a0-6e08488776a0 on hv-cinder-85505 Aug 30 16:10:51.449395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-f7428857-57a1-4a01-bcc2-9a35fafbe222 req-addd1163-0ac2-451b-932f-d00c3159cc4d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035473 Aug 30 16:10:51.453320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 501/993] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:51.859429 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-3bf65bc2-f3dd-46d7-9479-e7cf4ba67bda req-37019ebe-c1ed-48ea-812a-1b1a1abdcc2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8246872b-3fac-4df8-961a-703e059990b0", "name": "network-vif-deleted", "tag": "35c7dd88-f016-4de9-9319-02217d847571"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:51.881686 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3bf65bc2-f3dd-46d7-9479-e7cf4ba67bda req-37019ebe-c1ed-48ea-812a-1b1a1abdcc2d service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:51.882468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3bf65bc2-f3dd-46d7-9479-e7cf4ba67bda req-37019ebe-c1ed-48ea-812a-1b1a1abdcc2d service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:51.883056 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-3bf65bc2-f3dd-46d7-9479-e7cf4ba67bda req-37019ebe-c1ed-48ea-812a-1b1a1abdcc2d service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:51.912841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-3bf65bc2-f3dd-46d7-9479-e7cf4ba67bda req-37019ebe-c1ed-48ea-812a-1b1a1abdcc2d service nova] Creating event network-vif-deleted:35c7dd88-f016-4de9-9319-02217d847571 for instance 8246872b-3fac-4df8-961a-703e059990b0 on hv-cinder-85505 Aug 30 16:10:51.919266 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-3bf65bc2-f3dd-46d7-9479-e7cf4ba67bda req-37019ebe-c1ed-48ea-812a-1b1a1abdcc2d service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.163134 Aug 30 16:10:51.926174 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 493/994] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:52.348897 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:52.349779 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:52.361903 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.362471 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.363001 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.363789 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.369805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.369805 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.380114 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:52.381399 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:52.390407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.390668 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.391482 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.392517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.393447 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.393922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.416129 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.416924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.417598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.418240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lazy-loading 'fault' on Instance uuid 0807429c-12cc-47c7-94a0-6e08488776a0 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:52.434681 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:52.435252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:52.435750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:52.436257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.objects.instance [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lazy-loading 'fault' on Instance uuid 8246872b-3fac-4df8-961a-703e059990b0 {{(pid=120697) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:10:52.498494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cd3f1cbe0eb496f8e4c0692366fdefb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12d8ded5bfda4c8ebb281a5504b56eb1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.504231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:52.506947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a5760fe6-9502-4cac-9216-5296b4e5184b tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 200 len: 1327 microversion: 2.1 time: 0.135541 Aug 30 16:10:52.508022 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 494/995] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:52 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 1327 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:52.515237 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3db0a753-5fe5-4cae-99bb-37a5cacb5140 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 200 len: 1229 microversion: 2.1 time: 0.170772 Aug 30 16:10:52.515815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 502/996] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:52 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 1229 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:53.529933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:53.530628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:53.536138 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:53.536854 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:53.537198 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.537702 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.538137 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.538831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.539278 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.539747 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.544435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.544918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.545385 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.546071 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:53.546518 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:53.546935 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:53.553651 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] HTTP exception thrown: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Request method failure captured: Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 HTTP/1.1 Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjWFlqPdueO-8IRgp9rNQ2v-hffuVdHQEbktH1U3i38lPV32p9y5kPNn0qc2GflSCBJy_VhFMx4T5rwZJeMOdqZXowlZ4hFQdj6WMffRc0mqVofMc2iB3ynh-fdUnCZoHZydAS_TnznTIWJIouVk7VU5ZknRe6QtkAdlNvG-RnJD-Tk Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:10:53.555317 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 1cd3f1cbe0eb496f8e4c0692366fdefb Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:53.556962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '8246872b-3fac-4df8-961a-703e059990b0'} Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:53.558231 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:53.559688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.561007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Returning 404 to user: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:53.561007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-398dc502-95a0-4af3-9bc9-840f53e1154e tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 404 len: 111 microversion: 2.1 time: 0.030842 Aug 30 16:10:53.561007 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 495/997] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:53 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:53.561323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] HTTP exception thrown: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Request method failure captured: Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 HTTP/1.1 Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjXtDMXJ6xGO8eXz90I9LKKKuX9vc-o1xY0QY91MCBAemRTvApJSvWiivQxXe0nLONE1TV5OT65KB4ce8Me9i3sze8yXKZG4YwdxZp0nEQ9kbDERaO-rjQhNOQKZZwUI4sv7c4iTQe1Pd5uUl1tidl5LIXhyrVp9i__3PGMWLaHihaM Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:10:53.562495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-67327714 Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 02287f232cdd4842a747bb749b483cc3 Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:10:53.564098 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '0807429c-12cc-47c7-94a0-6e08488776a0'} Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:53.565176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:10:53.566462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:53.567594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Returning 404 to user: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:53.567594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5814437f-ef81-4dd3-9136-adee7373f505 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 404 len: 111 microversion: 2.1 time: 0.031854 Aug 30 16:10:53.567594 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 503/998] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:53 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:53.567796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c817718d-2689-46ce-969f-e9fe2db3024c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '.version_select at 0x7f4843f69a60>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:53.590347 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c817718d-2689-46ce-969f-e9fe2db3024c tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-381933107" status: 202 len: 0 microversion: 2.1 time: 0.028483 Aug 30 16:10:53.591430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 496/999] 10.222.0.20 () {58 vars in 1218 bytes} [Tue Aug 30 16:10:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-381933107 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:10:53.617087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-953992308", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-452120714", "security_groups": [{"name": "tempest-secgroup-smoke-1824698181"}], "block_device_mapping_v2": [{"uuid": "42bbc6e8-1b87-4774-8755-2c5a67e08f49", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36933f32-1926-4128-9b37-25f6ad22f3f3"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:53.741067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] validate_networks() for [('36933f32-1926-4128-9b37-25f6ad22f3f3', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:10:54.124683 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:10:54.125119 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:10:54.125619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:10:54.126044 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:10:54.126452 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:10:54.136254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:54.136933 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:54.137397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.138289 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:54.138748 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:54.139170 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:54.156838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:10:54.160838 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for user 02287f232cdd4842a747bb749b483cc3 and project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:10:54.218209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:10:54.220527 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='42bbc6e8-1b87-4774-8755-2c5a67e08f49',volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:10:54.358226 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3c0ee4ec-46ed-4271-a812-1eb5f79222aa tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.746984 Aug 30 16:10:54.358863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 504/1000] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:10:53 2022] POST /compute/v2.1/servers => generated 406 bytes in 748 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:10:54.369644 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-815afdc4-dff1-43cc-8073-7b06bac9b9fb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:54.370253 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-815afdc4-dff1-43cc-8073-7b06bac9b9fb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:54.424477 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-815afdc4-dff1-43cc-8073-7b06bac9b9fb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:54.432618 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-815afdc4-dff1-43cc-8073-7b06bac9b9fb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1093 microversion: 2.1 time: 0.066810 Aug 30 16:10:54.433200 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 497/1001] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:54 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:55.454127 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:55.454732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:55.457501 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=51,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:55.464451 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:55.465029 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:55.465607 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:55.466302 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:55.466745 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:55.467152 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:55.470707 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:55.549249 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:55.557589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e69be5f6-b695-4c7d-a360-c72a4a86b656 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1191 microversion: 2.1 time: 0.108047 Aug 30 16:10:55.558091 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 505/1002] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:55 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1191 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:56.538335 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.538946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.546047 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.546533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.546962 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.547896 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.548496 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.548927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.553372 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:56.563532 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] HTTP exception thrown: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Request method failure captured: Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 HTTP/1.1 Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjWFlqPdueO-8IRgp9rNQ2v-hffuVdHQEbktH1U3i38lPV32p9y5kPNn0qc2GflSCBJy_VhFMx4T5rwZJeMOdqZXowlZ4hFQdj6WMffRc0mqVofMc2iB3ynh-fdUnCZoHZydAS_TnznTIWJIouVk7VU5ZknRe6QtkAdlNvG-RnJD-Tk Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:10:56.565228 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 1cd3f1cbe0eb496f8e4c0692366fdefb Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.566712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '8246872b-3fac-4df8-961a-703e059990b0'} Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:56.570773 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.572179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.573922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Returning 404 to user: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:56.573922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de941e2d-d07b-4e69-a7ad-496ab3248817 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 404 len: 111 microversion: 2.1 time: 0.032188 Aug 30 16:10:56.573922 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 498/1003] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:56 2022] DELETE /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:56.575495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.576103 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 8246872b-3fac-4df8-961a-703e059990b0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.582331 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.582812 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.583241 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.583934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.584460 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.584904 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.590569 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:56.591184 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:56.604846 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.605371 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.605813 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.606533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:56.606986 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:56.607410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:56.617376 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] HTTP exception thrown: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Request method failure captured: Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 HTTP/1.1 Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjWFlqPdueO-8IRgp9rNQ2v-hffuVdHQEbktH1U3i38lPV32p9y5kPNn0qc2GflSCBJy_VhFMx4T5rwZJeMOdqZXowlZ4hFQdj6WMffRc0mqVofMc2iB3ynh-fdUnCZoHZydAS_TnznTIWJIouVk7VU5ZknRe6QtkAdlNvG-RnJD-Tk Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:10:56.618950 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 1cd3f1cbe0eb496f8e4c0692366fdefb Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.620444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '8246872b-3fac-4df8-961a-703e059990b0'} Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:56.621268 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. Aug 30 16:10:56.622538 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:56.623657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Returning 404 to user: Instance 8246872b-3fac-4df8-961a-703e059990b0 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:56.623657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f8f9c967-60e8-4732-91f5-77acde0a3e7d tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0" status: 404 len: 111 microversion: 2.1 time: 0.048952 Aug 30 16:10:56.623657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 506/1004] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:56 2022] GET /compute/v2.1/servers/8246872b-3fac-4df8-961a-703e059990b0 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 30 16:10:56.798241 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:56.805979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3cd44eed-746a-4b94-9f33-ffb5da2ae3f8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.219589 Aug 30 16:10:56.806538 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 499/1005] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:56 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:10:57.003847 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-af955622-d0c7-49f4-96ab-fc5b2556b885 req-07bcb2cf-ef41-49c7-a4d3-c2735532009e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c334ad9-ccb3-4514-ba5c-3db74a981527", "tag": "b39a280c-762c-464e-8926-321969376208"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:10:57.016717 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-af955622-d0c7-49f4-96ab-fc5b2556b885 req-07bcb2cf-ef41-49c7-a4d3-c2735532009e service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.017180 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-af955622-d0c7-49f4-96ab-fc5b2556b885 req-07bcb2cf-ef41-49c7-a4d3-c2735532009e service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.017627 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-af955622-d0c7-49f4-96ab-fc5b2556b885 req-07bcb2cf-ef41-49c7-a4d3-c2735532009e service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.029960 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-af955622-d0c7-49f4-96ab-fc5b2556b885 req-07bcb2cf-ef41-49c7-a4d3-c2735532009e service nova] Creating event network-changed:b39a280c-762c-464e-8926-321969376208 for instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 on hv-cinder-85505 Aug 30 16:10:57.035003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-af955622-d0c7-49f4-96ab-fc5b2556b885 req-07bcb2cf-ef41-49c7-a4d3-c2735532009e service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035108 Aug 30 16:10:57.035793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 507/1006] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:10:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:10:57.769865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.770439 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.772776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:10:57.785858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.786353 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.787464 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.787464 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.787899 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.788343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.805518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] HTTP exception thrown: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Request method failure captured: Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a HTTP/1.1 Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjWFlqPdueO-8IRgp9rNQ2v-hffuVdHQEbktH1U3i38lPV32p9y5kPNn0qc2GflSCBJy_VhFMx4T5rwZJeMOdqZXowlZ4hFQdj6WMffRc0mqVofMc2iB3ynh-fdUnCZoHZydAS_TnznTIWJIouVk7VU5ZknRe6QtkAdlNvG-RnJD-Tk Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:10:57.807161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 1cd3f1cbe0eb496f8e4c0692366fdefb Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.808802 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '2c12da29-7487-4964-af58-1bc74336173a'} Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:57.809724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.811227 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.812684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Returning 404 to user: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:57.812684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-00ea759b-5f43-489e-a0de-8cd895d7fcbc tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 404 len: 111 microversion: 2.1 time: 0.042806 Aug 30 16:10:57.812684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 500/1007] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:10:57 2022] DELETE /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:57.818204 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.818893 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] [instance: 2c12da29-7487-4964-af58-1bc74336173a] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.825066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.825581 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.826224 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.826912 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.827338 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.827577 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:57.827769 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.828320 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:57.835441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.836074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.836649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.837529 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:57.838277 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:57.838815 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:57.844263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] HTTP exception thrown: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Request method failure captured: Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a HTTP/1.1 Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjWFlqPdueO-8IRgp9rNQ2v-hffuVdHQEbktH1U3i38lPV32p9y5kPNn0qc2GflSCBJy_VhFMx4T5rwZJeMOdqZXowlZ4hFQdj6WMffRc0mqVofMc2iB3ynh-fdUnCZoHZydAS_TnznTIWJIouVk7VU5ZknRe6QtkAdlNvG-RnJD-Tk Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:10:57.844741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_12d8ded5bfda4c8ebb281a5504b56eb1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 12d8ded5bfda4c8ebb281a5504b56eb1 Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1239798087 Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 1cd3f1cbe0eb496f8e4c0692366fdefb Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-AttachVolumeTestJSON-1239798087-project Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.847298 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '2c12da29-7487-4964-af58-1bc74336173a'} Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:10:57.849255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. Aug 30 16:10:57.850589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:10:57.854533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] Returning 404 to user: Instance 2c12da29-7487-4964-af58-1bc74336173a could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:10:57.854533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ab34b543-8eb8-48ae-95ae-ab9403c9a843 tempest-AttachVolumeTestJSON-1239798087 tempest-AttachVolumeTestJSON-1239798087-project] 10.222.0.20 "GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a" status: 404 len: 111 microversion: 2.1 time: 0.032634 Aug 30 16:10:57.854533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 508/1008] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/servers/2c12da29-7487-4964-af58-1bc74336173a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:10:58.067865 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:58.077019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-30e8e0e1-9102-4fec-bc78-3a6ed4c645b9 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.253814 Aug 30 16:10:58.077624 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 501/1009] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:57 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:10:59.097875 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:10:59.098789 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:10:59.105496 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.105982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.106413 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.107101 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:10:59.107549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:10:59.107966 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:10:59.249754 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:10:59.258300 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ffa9d1e9-66ee-4c57-bee4-b27205a1cc5a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.164556 Aug 30 16:10:59.258863 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 509/1010] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:10:59 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:00.279135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:00.280312 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:00.287367 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:00.287849 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:00.288465 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:00.293547 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:00.294018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:00.294445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:00.512222 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:00.520902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a8ed785a-1637-4e88-9a81-16d3a4ec7cf8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.245888 Aug 30 16:11:00.521517 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 502/1011] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:00 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:01.545485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:01.546092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:01.552621 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.553111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.553575 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.554273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:01.554730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:01.555157 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:01.700539 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:01.708306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-ba11243f-018d-47b1-acf8-f84c1dec6591 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.166865 Aug 30 16:11:01.718347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 510/1012] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:01 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:02.729789 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:02.730392 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:02.737083 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:02.737628 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:02.738051 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.738775 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:02.739272 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:02.739689 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:02.871630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:02.879518 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cd878de0-87db-429f-b591-37cbe0893953 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.153636 Aug 30 16:11:02.880082 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 503/1013] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:02 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:03.903336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:03.903895 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:03.910983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.911464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.911883 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:03.912558 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:03.912982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:03.913430 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:04.056485 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:04.068130 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e194cd16-1ed9-4596-89f8-1465846f4b46 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.170299 Aug 30 16:11:04.068927 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 511/1014] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:03 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:05.090649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:05.091359 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:05.093435 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:05.100076 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:05.100559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:05.101981 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.101981 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:05.102194 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:05.102570 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:05.244186 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:05.252340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-22a9ffba-1562-483f-a8b3-f9ac6bf25f29 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.166002 Aug 30 16:11:05.252893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 504/1015] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:05 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:06.274614 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:06.275209 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:06.277179 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:06.277843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:06.286078 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:06.286576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:06.287001 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:06.287698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:06.288147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:06.288567 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:06.429945 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:06.438551 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-2d7d7624-1473-40dd-8261-6ca1cbca0a0c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.167845 Aug 30 16:11:06.439304 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 512/1016] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:06 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:07.459242 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:07.459885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:07.466678 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.467171 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.467607 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.468330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:07.468772 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:07.469193 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:07.663383 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:07.671805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-a2f56d73-4cc6-4cf8-ba75-2737a9b314b3 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.216653 Aug 30 16:11:07.685946 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 505/1017] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:07 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:08.006505 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-07014df3-e51a-4d8a-8e04-f770db54f2fc req-1a430930-926b-414a-b7ac-c46e56824115 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c334ad9-ccb3-4514-ba5c-3db74a981527", "name": "network-vif-plugged", "status": "completed", "tag": "b39a280c-762c-464e-8926-321969376208"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:08.016774 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-07014df3-e51a-4d8a-8e04-f770db54f2fc req-1a430930-926b-414a-b7ac-c46e56824115 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.017385 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-07014df3-e51a-4d8a-8e04-f770db54f2fc req-1a430930-926b-414a-b7ac-c46e56824115 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.017892 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-07014df3-e51a-4d8a-8e04-f770db54f2fc req-1a430930-926b-414a-b7ac-c46e56824115 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.029085 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-07014df3-e51a-4d8a-8e04-f770db54f2fc req-1a430930-926b-414a-b7ac-c46e56824115 service nova] Creating event network-vif-plugged:b39a280c-762c-464e-8926-321969376208 for instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 on hv-cinder-85505 Aug 30 16:11:08.034280 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-07014df3-e51a-4d8a-8e04-f770db54f2fc req-1a430930-926b-414a-b7ac-c46e56824115 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.218791 Aug 30 16:11:08.034988 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 513/1018] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:08.693588 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:08.694243 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:08.701755 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.702249 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.705117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.705117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:08.705117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:08.705117 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:08.841642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:08.849737 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e95fbd3a-5369-4041-a554-b4e3eb36f5a7 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1265 microversion: 2.1 time: 0.160712 Aug 30 16:11:08.850308 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 506/1019] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:08 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:09.875285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:09.875960 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:09.882710 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.883194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.883619 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:09.884299 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:09.884746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:09.885144 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.024785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:10.037083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b8c3c0d5-d85d-43ad-bb92-0dcd8b261b72 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1451 microversion: 2.1 time: 0.168660 Aug 30 16:11:10.037781 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 514/1020] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:09 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1451 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:10.057916 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:10.058520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:10.065440 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.065924 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.066354 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.067041 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:10.067487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:10.067903 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:10.202043 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:10.212711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cbf43968-30a9-4a33-8d27-4a38e7949f25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1451 microversion: 2.1 time: 0.158421 Aug 30 16:11:10.213642 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 507/1021] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:10 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:11.843067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-8158a72b-d31c-4b62-a146-8ba8a3c1d89d req-17256384-c51e-4320-84ae-3c5b919724b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c334ad9-ccb3-4514-ba5c-3db74a981527", "tag": "b39a280c-762c-464e-8926-321969376208"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:11.853027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8158a72b-d31c-4b62-a146-8ba8a3c1d89d req-17256384-c51e-4320-84ae-3c5b919724b2 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:11.853521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8158a72b-d31c-4b62-a146-8ba8a3c1d89d req-17256384-c51e-4320-84ae-3c5b919724b2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:11.853940 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-8158a72b-d31c-4b62-a146-8ba8a3c1d89d req-17256384-c51e-4320-84ae-3c5b919724b2 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:11.864806 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-8158a72b-d31c-4b62-a146-8ba8a3c1d89d req-17256384-c51e-4320-84ae-3c5b919724b2 service nova] Creating event network-changed:b39a280c-762c-464e-8926-321969376208 for instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 on hv-cinder-85505 Aug 30 16:11:11.870056 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-8158a72b-d31c-4b62-a146-8ba8a3c1d89d req-17256384-c51e-4320-84ae-3c5b919724b2 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030975 Aug 30 16:11:11.870965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 515/1022] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:44.893400 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-cff8795d-0ccd-4731-a606-3311670dc2a8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Action: 'create', calling method: .version_select at 0x7f4843f77f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1980436508", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPULuGgKK957x9lG1CK/KVnflZ3R6mqGB2jJXfvbth9yVJWgLqKlIC/AZ9/Qm2jKC34n6LtUvyre/5SctDMjh6keIk4JQJ4zn/kciwlND0r2wZD5/IEJ2cp+gu3h8kzixA=="}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:44.899377 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:11:44.899550 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Tue Aug 30 16:11:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.20) !!! Aug 30 16:11:44.900768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=15 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:44.901468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=50 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:44.915920 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-cff8795d-0ccd-4731-a606-3311670dc2a8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Getting quotas for project 298e354e744742a3919e3dd321c84d4d. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:44.920103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.quota [None req-cff8795d-0ccd-4731-a606-3311670dc2a8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Getting quotas for user c5abe1348966489daba0656972760f65 and project 298e354e744742a3919e3dd321c84d4d. Resources: {'key_pairs'} {{(pid=120697) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:44.947636 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-cff8795d-0ccd-4731-a606-3311670dc2a8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.058165 Aug 30 16:11:44.948234 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 508/1023] 10.222.0.20 () {60 vars in 1159 bytes} [Tue Aug 30 16:11:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:11:45.000654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 30 16:11:45.001314 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Tue Aug 30 16:11:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.20) !!! Aug 30 16:11:45.002832 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=21 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:45.003568 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=45 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:45.009514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-795525082", "imageRef": "4ad30b53-47a4-43b0-9d93-853434c4d573", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1980436508", "networks": [{"uuid": "73160b67-b6ae-4c23-b61b-47fe1cf2ca97"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:45.066222 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] validate_networks() for [('73160b67-b6ae-4c23-b61b-47fe1cf2ca97', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:11:45.462580 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:11:45.463164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:11:45.463982 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:11:45.464559 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:11:45.465178 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:11:45.478593 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.479064 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.479489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.480196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:45.480639 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:45.481047 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:45.497794 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Getting quotas for project 298e354e744742a3919e3dd321c84d4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:11:45.501931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Getting quotas for user c5abe1348966489daba0656972760f65 and project 298e354e744742a3919e3dd321c84d4d. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:11:45.513321 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:11:45.515589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='4ad30b53-47a4-43b0-9d93-853434c4d573',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:11:45.568354 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-987c54c6-eaaa-4e54-9f5e-969bc2289d4d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.569577 Aug 30 16:11:45.569013 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 516/1024] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:11:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:11:45.579892 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-7335921a-6d2f-4fa8-bc2f-e7565f79a2c6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:45.580596 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-7335921a-6d2f-4fa8-bc2f-e7565f79a2c6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:45.635333 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-7335921a-6d2f-4fa8-bc2f-e7565f79a2c6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:45.642498 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-7335921a-6d2f-4fa8-bc2f-e7565f79a2c6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1258 microversion: 2.1 time: 0.066582 Aug 30 16:11:45.643363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 509/1025] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:45 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:46.662990 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:46.663583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:46.671498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:46.671979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:46.672598 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:46.673391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:46.673882 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:46.674303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:46.742353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:46.751624 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-d94cd15a-3bce-4c9f-90bc-0ef84d45837f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1310 microversion: 2.1 time: 0.093111 Aug 30 16:11:46.752223 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 517/1026] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:46 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1310 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:47.772403 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:47.772979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:47.784615 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.785108 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.785772 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.786662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:47.787274 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:47.787876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:47.932190 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:47.941094 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1642fc86-b272-449e-b1ed-1c8c50c3a0d4 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.172888 Aug 30 16:11:47.942313 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 510/1027] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:47 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:48.966058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:48.966891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:48.975579 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.976059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.976551 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:48.977260 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:48.977719 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:48.978180 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:49.118541 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:49.126972 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8d6fb6c8-de2d-4e89-a3f7-8fe162a40402 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.166594 Aug 30 16:11:49.127884 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 518/1028] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:48 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:50.148653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:50.149509 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:50.156251 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:50.157059 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:50.157553 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.158373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:50.158835 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:50.159305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:50.294237 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:50.302149 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-144f5511-5dd2-4717-93db-4c7c30d91d3e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.157655 Aug 30 16:11:50.302858 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 511/1029] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:50 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:51.326549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:51.327255 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:51.334992 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.335772 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.336401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.337112 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:51.337678 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:51.338067 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:51.479631 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:51.487609 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-143cab76-0063-405d-a08e-986dfb6de572 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.166831 Aug 30 16:11:51.488187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 519/1030] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:51 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:52.509835 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:52.510475 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:52.517926 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.518417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.518851 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.519561 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:52.520000 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:52.520449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:52.670293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:52.678315 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ea4e669c-b85b-429f-967d-2c8a37ca381d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.172636 Aug 30 16:11:52.679074 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 512/1031] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:52 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:53.699517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:53.700117 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:53.706690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:53.707219 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:53.707652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:53.708576 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:53.709032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:53.709793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:53.851420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:53.860320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-81cad5d8-3f4d-47a8-a72a-41036a4cd678 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.164674 Aug 30 16:11:53.861154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 520/1032] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:53 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:54.881467 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:54.882330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:54.889247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.889763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.890192 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:54.890885 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:54.891337 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:54.891750 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:55.025586 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:55.033591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-de755af4-6a74-4c34-ae90-b23e9b1cdcd8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.156097 Aug 30 16:11:55.034137 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 513/1033] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:54 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:56.054726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:56.055375 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:56.058483 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:56.059362 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:56.066164 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.066652 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.067079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:56.067777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.068234 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.068641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:56.239202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-45dfaeb8-b712-49b0-a1db-553f0f0eda4a req-7e33b47c-23da-4301-b65b-eb9d98e8c14b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:11:56.247904 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=6 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:11:56.251030 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45dfaeb8-b712-49b0-a1db-553f0f0eda4a req-7e33b47c-23da-4301-b65b-eb9d98e8c14b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:56.251525 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45dfaeb8-b712-49b0-a1db-553f0f0eda4a req-7e33b47c-23da-4301-b65b-eb9d98e8c14b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:56.252018 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-45dfaeb8-b712-49b0-a1db-553f0f0eda4a req-7e33b47c-23da-4301-b65b-eb9d98e8c14b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:56.264711 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-45dfaeb8-b712-49b0-a1db-553f0f0eda4a req-7e33b47c-23da-4301-b65b-eb9d98e8c14b service nova] Creating event network-changed:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:11:56.269902 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-45dfaeb8-b712-49b0-a1db-553f0f0eda4a req-7e33b47c-23da-4301-b65b-eb9d98e8c14b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034479 Aug 30 16:11:56.270819 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 514/1034] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:11:56.302021 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:56.312856 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bc39a35f-6fa8-46c3-9222-906ea9dd40f3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.262497 Aug 30 16:11:56.313785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 521/1035] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:56 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:57.341363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:57.342330 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:57.352999 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.353506 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.353929 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.354603 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:57.355067 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:57.355486 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:57.488721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:57.496776 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e9eba139-5f8e-45db-bb6d-2f08aad2d9c2 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.163432 Aug 30 16:11:57.497513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 515/1036] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:57 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:58.525740 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:58.526323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:58.533588 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.534074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.534495 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.535193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:58.535638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:58.536046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:58.680961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:58.689347 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-49687c8e-f926-4400-a689-cf7497a9e7bc tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.169606 Aug 30 16:11:58.689905 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 522/1037] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:58 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:11:59.714291 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:11:59.715264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:11:59.726653 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:59.727521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:59.727947 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:59.728639 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:11:59.729092 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:11:59.729521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:11:59.869257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:11:59.877444 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2acbdf3e-ad10-42c5-8b09-a3e4b6ab1a08 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.169686 Aug 30 16:11:59.878023 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 516/1038] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:11:59 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:00.901991 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:00.902723 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:00.911301 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:00.911918 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:00.912453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:00.913357 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:00.913931 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:00.914456 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:01.054517 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:01.062657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-9dddd2e0-ee92-4348-b51d-c6f230de59b5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.166804 Aug 30 16:12:01.063231 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 523/1039] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:00 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:02.086832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:02.087407 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:02.092450 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-05995671-b8a7-4049-9c07-c47dd6d7583f req-0029c85c-d15d-46da-b521-ac4ba5884486 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "name": "network-vif-plugged", "status": "completed", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:02.094207 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.094696 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.095187 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.095866 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.096247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.097305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.104556 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-05995671-b8a7-4049-9c07-c47dd6d7583f req-0029c85c-d15d-46da-b521-ac4ba5884486 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:02.105349 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-05995671-b8a7-4049-9c07-c47dd6d7583f req-0029c85c-d15d-46da-b521-ac4ba5884486 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:02.105768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-05995671-b8a7-4049-9c07-c47dd6d7583f req-0029c85c-d15d-46da-b521-ac4ba5884486 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:02.118287 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-05995671-b8a7-4049-9c07-c47dd6d7583f req-0029c85c-d15d-46da-b521-ac4ba5884486 service nova] Creating event network-vif-plugged:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:12:02.123547 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-05995671-b8a7-4049-9c07-c47dd6d7583f req-0029c85c-d15d-46da-b521-ac4ba5884486 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035858 Aug 30 16:12:02.124525 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 524/1040] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:02.234583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:02.242490 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2a0566c4-93b2-4dee-9923-36698aa13333 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.159786 Aug 30 16:12:02.243210 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 517/1041] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:02 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:03.268729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:03.269900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:03.278638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.279111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.279531 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.280207 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:03.280645 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:03.281058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:03.416346 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:03.425070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-94a18db2-e3e8-4d71-9995-237a222f63e6 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1358 microversion: 2.1 time: 0.163604 Aug 30 16:12:03.425669 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 525/1042] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:03 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:04.450382 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:04.451318 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:04.462235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.462715 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.463145 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.463836 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.464282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.464706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.602833 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:04.611217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96328220-d59c-4f54-b623-b3b5d54a5669 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1548 microversion: 2.1 time: 0.167627 Aug 30 16:12:04.611796 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 518/1043] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:04 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1548 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:04.631628 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:04.632360 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:04.638973 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.639658 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.640187 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.640653 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.641272 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.641726 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.786549 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:04.798627 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-690369c1-cec2-4147-8663-0340378c7361 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1548 microversion: 2.1 time: 0.170733 Aug 30 16:12:04.799393 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 526/1044] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:04 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:04.818365 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:04.823240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:04.824004 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Searching by: {'deleted': False, 'project_id': '298e354e744742a3919e3dd321c84d4d'} {{(pid=120697) get_all /opt/stack/nova/nova/compute/api.py:3017}} Aug 30 16:12:04.831147 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.831648 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.832081 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.832798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:04.833268 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:04.833696 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:04.927139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.multi_cell_list [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120697) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Aug 30 16:12:05.027485 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2ade99d9-b00b-4efa-bdf0-fde30434e297 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.212841 Aug 30 16:12:05.027981 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 519/1045] 10.222.0.20 () {58 vars in 1125 bytes} [Tue Aug 30 16:12:04 2022] GET /compute/v2.1/servers => generated 342 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:05.043771 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:05.044370 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:05.050401 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.050910 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.051323 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.051998 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:05.052532 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:05.052979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:05.186955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:05.195120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-a42ca2f5-57c0-44fc-8131-4e73d4fadddf tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1548 microversion: 2.1 time: 0.155494 Aug 30 16:12:05.195686 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 527/1046] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:05 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:06.786348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de"}} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:06.788610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:06.795733 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.796220 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.796656 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:06.797387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:06.797842 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:06.798271 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:07.084631 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-affac304-0e8a-417d-86c8-11c2f7076bba tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302196 Aug 30 16:12:07.085305 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 520/1047] 10.222.0.20 () {60 vars in 1323 bytes} [Tue Aug 30 16:12:06 2022] POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments => generated 194 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:14.750106 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:14.750685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:14.757674 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.758141 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.758676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.759350 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:14.759792 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:14.760198 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:14.916027 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:14.925480 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-cd12798e-f19d-405b-a29d-9df5598c357b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1594 microversion: 2.1 time: 0.179217 Aug 30 16:12:14.926058 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 528/1048] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:14 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1594 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:16.915868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:16.916759 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=37,nova_api:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:17.054158 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-9b845b9d-0b57-4938-ba07-dafc9ecb9dff req-5324303a-27c7-4a39-9ee4-9b1e2cb1261c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:17.065394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9b845b9d-0b57-4938-ba07-dafc9ecb9dff req-5324303a-27c7-4a39-9ee4-9b1e2cb1261c service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.065867 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9b845b9d-0b57-4938-ba07-dafc9ecb9dff req-5324303a-27c7-4a39-9ee4-9b1e2cb1261c service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.066299 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-9b845b9d-0b57-4938-ba07-dafc9ecb9dff req-5324303a-27c7-4a39-9ee4-9b1e2cb1261c service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.076807 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:17.079474 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-9b845b9d-0b57-4938-ba07-dafc9ecb9dff req-5324303a-27c7-4a39-9ee4-9b1e2cb1261c service nova] Creating event network-changed:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:12:17.085664 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-9b845b9d-0b57-4938-ba07-dafc9ecb9dff req-5324303a-27c7-4a39-9ee4-9b1e2cb1261c service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.171098 Aug 30 16:12:17.086655 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 521/1049] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:17.983877 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-444896938"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:17.984409 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:17.988158 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:17.991988 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.992764 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.993204 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.993953 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:17.994396 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:17.994872 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:17.998074 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=71 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:18.135135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.network.security_group_api [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Adding security group 306aba68-b1b9-4197-a704-b07fed559940 to port ce44ce69-e7a5-47ae-95cc-3b95880fe030 Aug 30 16:12:18.467613 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-57159bf2-e593-49bf-bfa4-89f8e68c384b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/action" status: 202 len: 0 microversion: 2.1 time: 0.487723 Aug 30 16:12:18.468229 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 529/1050] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:12:17 2022] POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/action => generated 0 bytes in 489 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:12:18.477717 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:18.478559 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:18.478749 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-c9d6c4da-9b1c-4687-bf0a-4ad0a1a98c30 req-b8cb1bef-862e-4d90-95ba-5bc009e490c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:18.487524 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.488011 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.488718 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.489520 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.489976 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.490401 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.496727 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c9d6c4da-9b1c-4687-bf0a-4ad0a1a98c30 req-b8cb1bef-862e-4d90-95ba-5bc009e490c9 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:18.497399 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c9d6c4da-9b1c-4687-bf0a-4ad0a1a98c30 req-b8cb1bef-862e-4d90-95ba-5bc009e490c9 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:18.506057 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-c9d6c4da-9b1c-4687-bf0a-4ad0a1a98c30 req-b8cb1bef-862e-4d90-95ba-5bc009e490c9 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:18.521979 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-c9d6c4da-9b1c-4687-bf0a-4ad0a1a98c30 req-b8cb1bef-862e-4d90-95ba-5bc009e490c9 service nova] Creating event network-changed:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:12:18.528879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-c9d6c4da-9b1c-4687-bf0a-4ad0a1a98c30 req-b8cb1bef-862e-4d90-95ba-5bc009e490c9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053516 Aug 30 16:12:18.530391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 530/1051] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:18.735610 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:18.744832 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-abcd2db3-767c-402e-8b8d-0e1dafab54fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1759 microversion: 2.1 time: 0.271476 Aug 30 16:12:18.745449 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 522/1052] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:18 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1759 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:35.777682 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:35.779977 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:35.782280 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:35.782941 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=5 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:35.789906 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.790395 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.790831 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.791533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.791989 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.792412 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.879793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-c0a807c0-f7cf-439c-aaa4-a30b83f0dda9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/action" status: 202 len: 0 microversion: 2.1 time: 0.106293 Aug 30 16:12:35.880443 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 531/1053] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:12:35 2022] POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:12:35.888880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:35.889556 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:35.892233 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=4 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:35.892961 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=7 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:35.899422 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.899890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.900363 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:35.901049 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:35.901516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:35.901933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:36.128769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:36.137519 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-48b0ab54-1ac2-4d43-9ed9-8e3b93fc609f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1751 microversion: 2.1 time: 0.252567 Aug 30 16:12:36.138132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 523/1054] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:35 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1751 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:37.169368 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:37.170569 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:37.179765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:37.180243 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:37.180676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:37.181417 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:37.181870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:37.182294 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:37.345520 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:37.354635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3e955bf6-4f89-4c17-bced-25b9f969539d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.193509 Aug 30 16:12:37.355176 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 532/1055] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:37 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:38.379455 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:38.380088 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:38.387769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.388245 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.388673 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.389388 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:38.389831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:38.390244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:38.535246 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:38.545002 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-4e8edd3b-a141-412b-8d21-de7b61065b92 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.172006 Aug 30 16:12:38.545591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 524/1056] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:38 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:39.566481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:39.567194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:39.573961 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.574442 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.574870 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.575554 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:39.576008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:39.576421 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:39.727046 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:39.735679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-36053c87-423b-4da9-9642-c05ca5a87270 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.173218 Aug 30 16:12:39.736250 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 533/1057] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:39 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:40.762169 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:40.763167 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:40.773644 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:40.774430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:40.775142 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:40.776260 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:40.776995 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:40.777724 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:40.929180 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:40.937970 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6d242b05-4386-4ff8-93fc-a548475b2390 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.182823 Aug 30 16:12:40.938549 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 525/1058] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:40 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:41.962770 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:41.963509 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:41.972419 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.972939 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.973521 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:41.974391 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:41.974956 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:41.975484 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:42.134398 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:42.143524 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51e6eebe-9d90-4034-8129-bd4d38c4058d tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.186758 Aug 30 16:12:42.144099 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 534/1059] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:41 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:43.169583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:43.170762 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:43.180005 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:43.180483 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:43.180905 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.181619 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:43.182067 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:43.182480 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:43.344614 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:43.358342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-236823f3-9859-4020-8fe4-4f26484ffd97 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.195342 Aug 30 16:12:43.359289 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 526/1060] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:43 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:44.387065 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:44.388140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:44.399120 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:44.399968 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:44.400685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:44.401880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:44.402638 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:44.403339 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:44.554821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:44.563730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-51598544-dde5-4ee0-aeef-ff1ce175f4ed tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.183330 Aug 30 16:12:44.564309 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 535/1061] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:44 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:45.584350 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:45.585090 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:45.591911 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.592418 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.592845 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.593560 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:45.594015 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:45.594427 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:45.743864 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:45.755202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0801f615-6776-455a-afe4-4b1316e50ad9 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.174599 Aug 30 16:12:45.755977 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 527/1062] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:45 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:46.218435 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-694580197", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-452120714", "security_groups": [{"name": "tempest-secgroup-smoke-1824698181"}], "block_device_mapping_v2": [{"uuid": "138de898-f711-4d7f-be83-0a9d9b4fd0ad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "36933f32-1926-4128-9b37-25f6ad22f3f3"}]}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:46.341746 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.network.neutron [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] validate_networks() for [('36933f32-1926-4128-9b37-25f6ad22f3f3', None, None, None, None, None)] {{(pid=120696) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Aug 30 16:12:46.777751 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:46.778389 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:46.785327 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.785763 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.786217 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.786912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.787362 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.787783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.792343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Flavor limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 30 16:12:46.792793 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Image limits 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 30 16:12:46.793285 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Flavor pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 30 16:12:46.793690 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Image pref 0:0:0 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 30 16:12:46.794095 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.virt.hardware [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120696) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 30 16:12:46.803026 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.803510 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.803938 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.804654 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:46.805109 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:46.805552 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:46.823263 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:393}} Aug 30 16:12:46.827821 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.quota [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Getting quotas for user 02287f232cdd4842a747bb749b483cc3 and project 330e7c1cf5894ac9b6d21915c5f645bc. Resources: {'ram', 'instances', 'cores'} {{(pid=120696) _get_quotas /opt/stack/nova/nova/quota.py:383}} Aug 30 16:12:46.888703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Going to run 1 instances... {{(pid=120696) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Aug 30 16:12:46.890839 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='138de898-f711-4d7f-be83-0a9d9b4fd0ad',volume_size=None,volume_type=None)] {{(pid=120696) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Aug 30 16:12:46.931880 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:46.940608 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-1cbb5617-3d93-48e0-b42a-a5ae03b4d13e tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.166931 Aug 30 16:12:46.941203 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 528/1063] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:46 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:47.028846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e87d2f32-d4e1-4515-a253-f77b273b8e28 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.814289 Aug 30 16:12:47.029543 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 536/1064] 10.222.0.20 () {60 vars in 1147 bytes} [Tue Aug 30 16:12:46 2022] POST /compute/v2.1/servers => generated 406 bytes in 816 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 30 16:12:47.040623 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f3e94a75-d165-4126-8b96-b328f4346ff8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:47.041438 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-f3e94a75-d165-4126-8b96-b328f4346ff8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:47.097662 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-f3e94a75-d165-4126-8b96-b328f4346ff8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:47.104521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f3e94a75-d165-4126-8b96-b328f4346ff8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1093 microversion: 2.1 time: 0.067881 Aug 30 16:12:47.105085 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 529/1065] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:47 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:47.967660 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:47.968580 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:47.979379 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:47.980191 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:47.980901 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:47.982077 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:47.982822 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:47.983527 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:48.125252 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:48.125875 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:48.133202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:48.133716 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:48.134143 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:48.134829 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:48.134947 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:48.135275 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:48.135688 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:48.143923 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-8c7bc7b1-7a09-4bd3-8372-9172fd4efdb8 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1756 microversion: 2.1 time: 0.183954 Aug 30 16:12:48.144529 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 537/1066] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:47 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:48.198667 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:48.207026 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2d4fd29a-05c8-4ada-b83b-8a69ff97ed1c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1191 microversion: 2.1 time: 0.085751 Aug 30 16:12:48.207712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 530/1067] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:48 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1191 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:49.165635 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:49.166295 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:49.173111 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.173657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.174088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.174785 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.175230 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.175643 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.228192 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:49.228848 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:49.235091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.235574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.236008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.236712 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:49.237160 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:49.237753 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:49.318102 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:49.326247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-e8d664f6-dffa-4fa3-a7f3-d12ce6da29a5 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1209 microversion: 2.1 time: 0.102014 Aug 30 16:12:49.326918 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 531/1068] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:49 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1209 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:49.449110 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:49.461730 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-e92e99a3-2a17-4a13-90ba-7161427648b7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1759 microversion: 2.1 time: 0.300171 Aug 30 16:12:49.462353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 538/1069] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:49 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1759 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:50.314213 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-979e7d1a-fe8f-40d2-9aa3-81173163fdd0 req-200b4709-be23-4969-90cd-e60527a823a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1220012f-46b8-454e-986c-795766bfc807", "tag": "f11ce5bb-7921-4f06-b8cb-97bd6f251133"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:12:50.325921 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-979e7d1a-fe8f-40d2-9aa3-81173163fdd0 req-200b4709-be23-4969-90cd-e60527a823a5 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.326462 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-979e7d1a-fe8f-40d2-9aa3-81173163fdd0 req-200b4709-be23-4969-90cd-e60527a823a5 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.326886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-979e7d1a-fe8f-40d2-9aa3-81173163fdd0 req-200b4709-be23-4969-90cd-e60527a823a5 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.339139 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-979e7d1a-fe8f-40d2-9aa3-81173163fdd0 req-200b4709-be23-4969-90cd-e60527a823a5 service nova] Creating event network-changed:f11ce5bb-7921-4f06-b8cb-97bd6f251133 for instance 1220012f-46b8-454e-986c-795766bfc807 on hv-cinder-85505 Aug 30 16:12:50.344122 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-979e7d1a-fe8f-40d2-9aa3-81173163fdd0 req-200b4709-be23-4969-90cd-e60527a823a5 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034697 Aug 30 16:12:50.344890 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 532/1070] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:12:50.356283 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:50.356946 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:50.363405 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.363891 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.364313 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.365008 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:50.365897 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:50.366735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:50.585866 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:50.594416 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-bb0ed4e4-6a0a-491c-9057-ba884d11e2ce tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.249938 Aug 30 16:12:50.595149 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 539/1071] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:50 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:12:51.617133 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:51.617873 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:51.624749 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:51.625257 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:51.625698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:51.626410 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:51.626862 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:51.627286 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:51.767641 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:51.775974 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-01dfe03a-aae6-46b5-a6f3-027754822c08 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.163291 Aug 30 16:12:51.776550 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 533/1072] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:51 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:52.805083 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:52.806082 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:52.817447 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.818254 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.818975 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.819851 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:52.820303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:52.820729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:52.964005 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:52.976500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f9395202-e06f-4ae6-8b65-3fdfd6b61b8b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.177794 Aug 30 16:12:52.977374 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 540/1073] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:52 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:54.002033 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:54.003010 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:54.011297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:54.011784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:54.012215 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:54.012912 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:54.013408 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:54.013841 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:54.149951 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:54.158066 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2c2cdae1-eb7e-442c-a184-f0d26552891e tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.162722 Aug 30 16:12:54.158649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 534/1074] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:53 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:55.179453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:55.180088 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:55.186936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:55.187420 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:55.187848 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:55.188516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:55.188964 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:55.189428 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:55.335641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:55.348132 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6bbf9a77-1043-4c2e-a61e-8f5a3dfa1b04 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.172368 Aug 30 16:12:55.348940 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 541/1075] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:55 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:56.379331 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:56.380348 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:56.391343 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.392132 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.392854 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.394240 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:56.395044 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:56.395741 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:56.551387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:56.560533 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-702c2f98-f502-42df-9ade-d9f22956ef50 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.187720 Aug 30 16:12:56.561091 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 535/1076] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:56 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:57.587410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:57.588384 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:57.592312 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=2 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:57.593415 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell0:SELECT=6 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:57.603974 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:57.604459 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:57.604888 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:57.605614 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:57.606062 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:57.606479 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:57.756463 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:57.764720 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dbb97c71-b027-4cf5-8c85-9afb48cfc87b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.185481 Aug 30 16:12:57.765294 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 542/1077] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:57 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:58.789540 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:58.790508 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:58.793599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell0:SELECT=2 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:12:58.801630 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.802394 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.803095 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.804423 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:58.804872 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:58.805310 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:58.937699 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:12:58.945782 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-2fa6fe0b-36af-4453-8238-65f836257b60 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.162725 Aug 30 16:12:58.946325 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 536/1078] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:58 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:12:59.971481 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:12:59.972516 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:12:59.980815 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.981308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.981739 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:12:59.982442 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:12:59.982898 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:12:59.983317 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.131741 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:00.141732 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-68970d55-0314-44f6-a4e9-d8debf5504ad tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.177217 Aug 30 16:13:00.142305 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 543/1079] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:12:59 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:00.485574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5f8f075c-97e0-4868-a41f-3089b81d9d87 req-1fdc45a7-3f93-46a3-bfaa-7fe44bbeeda1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1220012f-46b8-454e-986c-795766bfc807", "name": "network-vif-plugged", "status": "completed", "tag": "f11ce5bb-7921-4f06-b8cb-97bd6f251133"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:00.498375 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5f8f075c-97e0-4868-a41f-3089b81d9d87 req-1fdc45a7-3f93-46a3-bfaa-7fe44bbeeda1 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:00.498780 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5f8f075c-97e0-4868-a41f-3089b81d9d87 req-1fdc45a7-3f93-46a3-bfaa-7fe44bbeeda1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:00.499339 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5f8f075c-97e0-4868-a41f-3089b81d9d87 req-1fdc45a7-3f93-46a3-bfaa-7fe44bbeeda1 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:00.512399 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5f8f075c-97e0-4868-a41f-3089b81d9d87 req-1fdc45a7-3f93-46a3-bfaa-7fe44bbeeda1 service nova] Creating event network-vif-plugged:f11ce5bb-7921-4f06-b8cb-97bd6f251133 for instance 1220012f-46b8-454e-986c-795766bfc807 on hv-cinder-85505 Aug 30 16:13:00.517576 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5f8f075c-97e0-4868-a41f-3089b81d9d87 req-1fdc45a7-3f93-46a3-bfaa-7fe44bbeeda1 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035775 Aug 30 16:13:00.518373 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 537/1080] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:01.166685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:01.167693 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:01.178501 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:01.179308 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:01.180025 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.181166 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:01.181965 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:01.182676 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:01.334752 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:01.347589 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-35550006-41f6-4bcc-a5f4-92477bb26653 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1265 microversion: 2.1 time: 0.187294 Aug 30 16:13:01.348438 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 544/1081] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:01 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1265 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:02.371387 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:02.372123 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:02.380324 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.380798 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.381247 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.381981 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.382434 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.382843 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.519430 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:02.527658 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-c8aeb88c-8938-4891-b6f4-52c0e000ba70 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1451 microversion: 2.1 time: 0.161178 Aug 30 16:13:02.528208 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 538/1082] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:02 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:02.547641 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:02.548240 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:02.555092 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.555570 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.555998 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.556679 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:02.557125 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:02.557577 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:02.697777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:02.705925 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-686442d5-bd66-436b-95e9-95f2e7cf4b2c tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1451 microversion: 2.1 time: 0.162122 Aug 30 16:13:02.706500 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 545/1083] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:02 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:04.612863 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-f4160b3e-51ed-4d62-916a-00775c3604c2 req-9ccd2575-b08c-4357-b75c-32e2ab8d67d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1220012f-46b8-454e-986c-795766bfc807", "tag": "f11ce5bb-7921-4f06-b8cb-97bd6f251133"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:04.622304 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4160b3e-51ed-4d62-916a-00775c3604c2 req-9ccd2575-b08c-4357-b75c-32e2ab8d67d9 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:04.622769 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4160b3e-51ed-4d62-916a-00775c3604c2 req-9ccd2575-b08c-4357-b75c-32e2ab8d67d9 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:04.623417 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-f4160b3e-51ed-4d62-916a-00775c3604c2 req-9ccd2575-b08c-4357-b75c-32e2ab8d67d9 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:04.634948 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-f4160b3e-51ed-4d62-916a-00775c3604c2 req-9ccd2575-b08c-4357-b75c-32e2ab8d67d9 service nova] Creating event network-changed:f11ce5bb-7921-4f06-b8cb-97bd6f251133 for instance 1220012f-46b8-454e-986c-795766bfc807 on hv-cinder-85505 Aug 30 16:13:04.639784 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-f4160b3e-51ed-4d62-916a-00775c3604c2 req-9ccd2575-b08c-4357-b75c-32e2ab8d67d9 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030770 Aug 30 16:13:04.640381 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 539/1084] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:21.957257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-444896938"}} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:21.957858 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:21.959782 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:21.960469 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:21.966297 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.966777 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.967206 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:21.967900 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:21.968348 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:21.968753 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:22.107462 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.network.security_group_api [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Removing security group 306aba68-b1b9-4197-a704-b07fed559940 from port ce44ce69-e7a5-47ae-95cc-3b95880fe030 Aug 30 16:13:22.421744 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-6f73d982-4c95-444d-9033-27bcc71223fe tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/action" status: 202 len: 0 microversion: 2.1 time: 0.468747 Aug 30 16:13:22.422383 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 546/1085] 10.222.0.20 () {60 vars in 1278 bytes} [Tue Aug 30 16:13:21 2022] POST /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/action => generated 0 bytes in 470 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:13:22.429284 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=36 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:22.430099 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=84 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:13:22.433984 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-5bc79d77-ef8c-4582-a097-b48c1ea33dc3 req-ba3d2e2e-a653-4dbf-84f8-bc4399849409 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:22.462098 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5bc79d77-ef8c-4582-a097-b48c1ea33dc3 req-ba3d2e2e-a653-4dbf-84f8-bc4399849409 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:22.462595 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5bc79d77-ef8c-4582-a097-b48c1ea33dc3 req-ba3d2e2e-a653-4dbf-84f8-bc4399849409 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:22.463230 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-5bc79d77-ef8c-4582-a097-b48c1ea33dc3 req-ba3d2e2e-a653-4dbf-84f8-bc4399849409 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:22.481921 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-5bc79d77-ef8c-4582-a097-b48c1ea33dc3 req-ba3d2e2e-a653-4dbf-84f8-bc4399849409 service nova] Creating event network-changed:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:13:22.496297 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-5bc79d77-ef8c-4582-a097-b48c1ea33dc3 req-ba3d2e2e-a653-4dbf-84f8-bc4399849409 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068271 Aug 30 16:13:22.496669 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 540/1086] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:24.087193 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:24.087750 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:24.093780 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.094257 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.095002 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.095686 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.096128 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.096540 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.180036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.objects.instance [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lazy-loading 'services' on Instance uuid 4abbcfc5-3a34-40ef-9318-60870567c0c1 {{(pid=120696) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 30 16:13:24.257356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-1efe851f-f541-4ac2-8998-fcb6722f4134 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments/f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de" status: 202 len: 0 microversion: 2.1 time: 0.174300 Aug 30 16:13:24.257959 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 547/1087] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:13:24 2022] DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments/f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:13:24.267886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:24.270811 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:24.277794 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.278307 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.278721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.279649 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.280402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.280892 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.311916 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-54f69504-bc00-4896-af02-cf4cff5a23a3 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048923 Aug 30 16:13:24.312805 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 541/1088] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:13:24 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:24.510962 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-baf3b628-3a5a-4e77-b876-4b939c2eb3fd req-c3d0dba0-c4d5-4090-8d4e-179ba870f962 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:24.521105 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-baf3b628-3a5a-4e77-b876-4b939c2eb3fd req-c3d0dba0-c4d5-4090-8d4e-179ba870f962 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:24.521657 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-baf3b628-3a5a-4e77-b876-4b939c2eb3fd req-c3d0dba0-c4d5-4090-8d4e-179ba870f962 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:24.522097 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-baf3b628-3a5a-4e77-b876-4b939c2eb3fd req-c3d0dba0-c4d5-4090-8d4e-179ba870f962 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:24.534582 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-baf3b628-3a5a-4e77-b876-4b939c2eb3fd req-c3d0dba0-c4d5-4090-8d4e-179ba870f962 service nova] Creating event network-changed:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:13:24.539444 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-baf3b628-3a5a-4e77-b876-4b939c2eb3fd req-c3d0dba0-c4d5-4090-8d4e-179ba870f962 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032586 Aug 30 16:13:24.540089 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 548/1089] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:13:25.323868 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:25.326169 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:25.334847 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.335448 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.335927 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.336888 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.337626 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.338202 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.369135 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-ad9c17d4-e746-4653-af4a-ce91132bc973 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049343 Aug 30 16:13:25.369859 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 542/1090] 10.222.0.20 () {58 vars in 1302 bytes} [Tue Aug 30 16:13:25 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 30 16:13:25.385482 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:25.386127 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:25.393177 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.393703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.394127 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.394843 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:25.395282 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:25.395704 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:25.481601 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] HTTP exception thrown: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 is not attached to volume f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Request method failure captured: Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments/f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de HTTP/1.1 Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjayGM0DirotbLL7YifJAMwQ64g1kyzCdwrV-sf0x3PUPC4Fo91M4NIsX0R9pdMxt4D893XLCoT48VRcqphfPaurIlRJSfIIXdhalhDwt-X83uhTTxZo90NY0xiYJK904mrG6yQZK10wUD4MSTpRPzPWqbzXC6xA1skp0WJB_CW6UqU Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 298e354e744742a3919e3dd321c84d4d Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestMinimumBasicScenario-567995307 Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:13:25.490636 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/298e354e744742a3919e3dd321c84d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/298e354e744742a3919e3dd321c84d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/298e354e744742a3919e3dd321c84d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_298e354e744742a3919e3dd321c84d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestMinimumBasicScenario-567995307 Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 298e354e744742a3919e3dd321c84d4d Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestMinimumBasicScenario-567995307 Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-TestMinimumBasicScenario-567995307-project Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: c5abe1348966489daba0656972760f65 Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestMinimumBasicScenario-567995307-project Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:13:25.492365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 is not attached to volume f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'server_id': '4abbcfc5-3a34-40ef-9318-60870567c0c1', 'id': 'f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de'} Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de. Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:13:25.493353 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 is not attached to volume f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 is not attached to volume f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:13:25.494955 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Returning 404 to user: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 is not attached to volume f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:13:25.496489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-b8924490-79bf-4201-b0db-e35db9bcab42 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments/f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de" status: 404 len: 154 microversion: 2.1 time: 0.114954 Aug 30 16:13:25.496489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 549/1091] 10.222.0.20 () {58 vars in 1416 bytes} [Tue Aug 30 16:13:25 2022] DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1/os-volume_attachments/f52d2c17-fc6f-4fa7-b7f5-0ea4dc4894de => generated 154 bytes in 117 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:13:26.652488 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:26.653025 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:26.660249 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.660730 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.661164 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.661891 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.662338 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.662756 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.689516 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:13:26.780142 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-40fe9880-fddf-4ec1-8f22-7b33d39c00d5 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 204 len: 0 microversion: 2.1 time: 0.131289 Aug 30 16:13:26.780933 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 543/1092] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:13:26 2022] DELETE /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:13:26.789453 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:26.790087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:26.796664 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.797145 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.797606 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.798292 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:26.798735 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:26.799147 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:26.937003 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:26.954059 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-5fd342c8-05a7-4b67-b96e-b6ec066779d0 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1554 microversion: 2.1 time: 0.168526 Aug 30 16:13:26.954642 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 550/1093] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:26 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1554 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:27.981620 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:27.982814 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:27.989901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.990402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.990834 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:27.991530 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:27.991979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:27.992402 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:28.131212 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:28.142351 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-53e66c5e-bd54-4ea1-b9b2-05de1fc18933 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1554 microversion: 2.1 time: 0.165477 Aug 30 16:13:28.143144 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 544/1094] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:27 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1554 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:29.168431 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:29.169135 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:29.176698 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.177184 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.178541 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.179281 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.179729 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.180143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.192511 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [req-2ee54f35-c9c0-44c5-8364-463be52931ca req-f6ae8fce-be3c-4934-9800-da41ccc53995 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4abbcfc5-3a34-40ef-9318-60870567c0c1", "name": "network-vif-deleted", "tag": "ce44ce69-e7a5-47ae-95cc-3b95880fe030"}]} {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:13:29.203808 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ee54f35-c9c0-44c5-8364-463be52931ca req-f6ae8fce-be3c-4934-9800-da41ccc53995 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:29.204296 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ee54f35-c9c0-44c5-8364-463be52931ca req-f6ae8fce-be3c-4934-9800-da41ccc53995 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:29.204723 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [req-2ee54f35-c9c0-44c5-8364-463be52931ca req-f6ae8fce-be3c-4934-9800-da41ccc53995 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:29.221954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.compute.server_external_events [req-2ee54f35-c9c0-44c5-8364-463be52931ca req-f6ae8fce-be3c-4934-9800-da41ccc53995 service nova] Creating event network-vif-deleted:ce44ce69-e7a5-47ae-95cc-3b95880fe030 for instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 on hv-cinder-85505 Aug 30 16:13:29.228179 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [req-2ee54f35-c9c0-44c5-8364-463be52931ca req-f6ae8fce-be3c-4934-9800-da41ccc53995 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039164 Aug 30 16:13:29.228837 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 545/1095] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:13:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:13:29.253194 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c5abe1348966489daba0656972760f65', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '298e354e744742a3919e3dd321c84d4d', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:13:29.261196 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7df918dd-44f8-437d-a5de-58fe0b5b807b tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 200 len: 1512 microversion: 2.1 time: 0.097188 Aug 30 16:13:29.261823 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 551/1096] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:29 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 1512 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:13:30.283019 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:30.283911 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] [instance: 4abbcfc5-3a34-40ef-9318-60870567c0c1] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:13:30.290960 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:30.291468 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:30.291973 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:30.292706 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:13:30.293154 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:13:30.293599 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:13:30.307390 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] HTTP exception thrown: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 could not be found. Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Request method failure captured: Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 HTTP/1.1 Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjayGM0DirotbLL7YifJAMwQ64g1kyzCdwrV-sf0x3PUPC4Fo91M4NIsX0R9pdMxt4D893XLCoT48VRcqphfPaurIlRJSfIIXdhalhDwt-X83uhTTxZo90NY0xiYJK904mrG6yQZK10wUD4MSTpRPzPWqbzXC6xA1skp0WJB_CW6UqU Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 298e354e744742a3919e3dd321c84d4d Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-TestMinimumBasicScenario-567995307 Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:13:30.309017 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/298e354e744742a3919e3dd321c84d4d"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/298e354e744742a3919e3dd321c84d4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/298e354e744742a3919e3dd321c84d4d"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_298e354e744742a3919e3dd321c84d4d"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-TestMinimumBasicScenario-567995307 Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 298e354e744742a3919e3dd321c84d4d Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestMinimumBasicScenario-567995307 Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-TestMinimumBasicScenario-567995307-project Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: c5abe1348966489daba0656972760f65 Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-TestMinimumBasicScenario-567995307-project Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 could not be found. Aug 30 16:13:30.311009 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '4abbcfc5-3a34-40ef-9318-60870567c0c1'} Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 could not be found. Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:13:30.311954 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 could not be found. Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 could not be found. Aug 30 16:13:30.313487 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:13:30.314768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Returning 404 to user: Instance 4abbcfc5-3a34-40ef-9318-60870567c0c1 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:13:30.314768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-3a2b52bb-32ea-4044-8813-118652920f6f tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1" status: 404 len: 111 microversion: 2.1 time: 0.031963 Aug 30 16:13:30.314768 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 546/1097] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:13:30 2022] GET /compute/v2.1/servers/4abbcfc5-3a34-40ef-9318-60870567c0c1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:13:30.319497 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-f123f330-7b9e-4ac8-ba16-71f557263ac7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] Calling method '.version_select at 0x7f4848ddaa60>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:13:30.345464 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-f123f330-7b9e-4ac8-ba16-71f557263ac7 tempest-TestMinimumBasicScenario-567995307 tempest-TestMinimumBasicScenario-567995307-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1980436508" status: 202 len: 0 microversion: 2.1 time: 0.029669 Aug 30 16:13:30.346039 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 552/1098] 10.222.0.20 () {58 vars in 1272 bytes} [Tue Aug 30 16:13:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1980436508 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 30 16:14:36.953783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_api:SELECT=19,nova_api:UPDATE=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:36.954522 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG dbcounter [-] [120697] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120697) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:36.960440 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_cell1:SELECT=33,nova_cell1:INSERT=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:36.961181 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG dbcounter [-] [120696] Writing DB stats nova_api:SELECT=15,nova_api:DELETE=1 {{(pid=120696) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 30 16:14:36.967248 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:36.968066 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:36.969579 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-3ae08d7c-32b5-4d01-8891-ac8b92650e0d req-00974e17-e43e-4349-a8dd-36140deb4056 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1220012f-46b8-454e-986c-795766bfc807", "tag": "f11ce5bb-7921-4f06-b8cb-97bd6f251133"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:36.977797 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.978340 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.978959 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.979908 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.980337 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.980752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.982983 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ae08d7c-32b5-4d01-8891-ac8b92650e0d req-00974e17-e43e-4349-a8dd-36140deb4056 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:36.983457 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ae08d7c-32b5-4d01-8891-ac8b92650e0d req-00974e17-e43e-4349-a8dd-36140deb4056 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:36.983880 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-3ae08d7c-32b5-4d01-8891-ac8b92650e0d req-00974e17-e43e-4349-a8dd-36140deb4056 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:36.995969 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-3ae08d7c-32b5-4d01-8891-ac8b92650e0d req-00974e17-e43e-4349-a8dd-36140deb4056 service nova] Creating event network-changed:f11ce5bb-7921-4f06-b8cb-97bd6f251133 for instance 1220012f-46b8-454e-986c-795766bfc807 on hv-cinder-85505 Aug 30 16:14:37.001007 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-3ae08d7c-32b5-4d01-8891-ac8b92650e0d req-00974e17-e43e-4349-a8dd-36140deb4056 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042507 Aug 30 16:14:37.001747 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 553/1099] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:37.009053 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:14:37.091513 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-08cb1ff8-4095-4b40-982f-aad91ed4643a tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "DELETE /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 204 len: 0 microversion: 2.1 time: 0.139531 Aug 30 16:14:37.092282 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 547/1100] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:36 2022] DELETE /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:37.101934 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:37.102708 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:37.108986 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.109503 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.109936 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.110629 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:37.111140 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:37.111590 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:37.364079 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:37.372583 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-21eda1ba-dd39-4d46-8c70-2a537fc6bc11 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1575 microversion: 2.1 time: 0.275239 Aug 30 16:14:37.373279 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 554/1101] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:37 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1575 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:38.397250 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:38.398098 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:38.406261 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.406831 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.407342 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.408152 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:38.408679 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:38.409173 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:38.611497 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:38.619665 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-0d352063-2203-4c83-b292-0d90c8da01a1 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1575 microversion: 2.1 time: 0.227964 Aug 30 16:14:38.620205 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 548/1102] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:38 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1575 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:39.547498 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-6162ea61-1e10-4d2a-bba3-426ecf40a805 req-11c4c6ca-6d2d-4d9f-99b6-09d7cb85678b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1220012f-46b8-454e-986c-795766bfc807", "name": "network-vif-deleted", "tag": "f11ce5bb-7921-4f06-b8cb-97bd6f251133"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:39.559369 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6162ea61-1e10-4d2a-bba3-426ecf40a805 req-11c4c6ca-6d2d-4d9f-99b6-09d7cb85678b service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.559879 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6162ea61-1e10-4d2a-bba3-426ecf40a805 req-11c4c6ca-6d2d-4d9f-99b6-09d7cb85678b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.560410 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-6162ea61-1e10-4d2a-bba3-426ecf40a805 req-11c4c6ca-6d2d-4d9f-99b6-09d7cb85678b service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.576048 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-6162ea61-1e10-4d2a-bba3-426ecf40a805 req-11c4c6ca-6d2d-4d9f-99b6-09d7cb85678b service nova] Creating event network-vif-deleted:f11ce5bb-7921-4f06-b8cb-97bd6f251133 for instance 1220012f-46b8-454e-986c-795766bfc807 on hv-cinder-85505 Aug 30 16:14:39.583533 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-6162ea61-1e10-4d2a-bba3-426ecf40a805 req-11c4c6ca-6d2d-4d9f-99b6-09d7cb85678b service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039922 Aug 30 16:14:39.584239 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 555/1103] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:39.639856 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:39.641293 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:39.649660 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.650171 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.650602 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.651309 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:39.651752 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:39.652185 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:39.716195 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:39.724445 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-17698565-12e1-4255-af8d-1e90881919b8 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 200 len: 1224 microversion: 2.1 time: 0.088481 Aug 30 16:14:39.725012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 549/1104] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:39 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 1224 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:40.745188 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:40.746032 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 1220012f-46b8-454e-986c-795766bfc807] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:40.753885 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:40.754449 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:40.754945 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:40.755786 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:40.756333 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:40.756810 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:40.771692 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] HTTP exception thrown: Instance 1220012f-46b8-454e-986c-795766bfc807 could not be found. Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Request method failure captured: Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 HTTP/1.1 Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjXtDMXJ6xGO8eXz90I9LKKKuX9vc-o1xY0QY91MCBAemRTvApJSvWiivQxXe0nLONE1TV5OT65KB4ce8Me9i3sze8yXKZG4YwdxZp0nEQ9kbDERaO-rjQhNOQKZZwUI4sv7c4iTQe1Pd5uUl1tidl5LIXhyrVp9i__3PGMWLaHihaM Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:14:40.773336 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 02287f232cdd4842a747bb749b483cc3 Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 1220012f-46b8-454e-986c-795766bfc807 could not be found. Aug 30 16:14:40.775090 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '1220012f-46b8-454e-986c-795766bfc807'} Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1220012f-46b8-454e-986c-795766bfc807 could not be found. Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:40.776172 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1220012f-46b8-454e-986c-795766bfc807 could not be found. Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1220012f-46b8-454e-986c-795766bfc807 could not be found. Aug 30 16:14:40.777846 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:40.779610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Returning 404 to user: Instance 1220012f-46b8-454e-986c-795766bfc807 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:40.779610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-7c5fedbf-ec81-4967-bc25-263f98577dcc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807" status: 404 len: 111 microversion: 2.1 time: 0.034237 Aug 30 16:14:40.779610 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 556/1105] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:40 2022] GET /compute/v2.1/servers/1220012f-46b8-454e-986c-795766bfc807 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:43.869244 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:43.869746 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:43.871474 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-e2964b4c-6910-4d16-b50e-d30b2483f83f req-4c34b944-33c1-49e7-87f8-3287ebbbbb67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3c334ad9-ccb3-4514-ba5c-3db74a981527", "tag": "b39a280c-762c-464e-8926-321969376208"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:43.876287 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.876765 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.877191 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.878226 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.878678 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.879112 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.882303 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e2964b4c-6910-4d16-b50e-d30b2483f83f req-4c34b944-33c1-49e7-87f8-3287ebbbbb67 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:43.882877 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e2964b4c-6910-4d16-b50e-d30b2483f83f req-4c34b944-33c1-49e7-87f8-3287ebbbbb67 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:43.883365 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-e2964b4c-6910-4d16-b50e-d30b2483f83f req-4c34b944-33c1-49e7-87f8-3287ebbbbb67 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:43.896295 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-e2964b4c-6910-4d16-b50e-d30b2483f83f req-4c34b944-33c1-49e7-87f8-3287ebbbbb67 service nova] Creating event network-changed:b39a280c-762c-464e-8926-321969376208 for instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 on hv-cinder-85505 Aug 30 16:14:43.902154 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-e2964b4c-6910-4d16-b50e-d30b2483f83f req-4c34b944-33c1-49e7-87f8-3287ebbbbb67 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034303 Aug 30 16:14:43.902765 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 557/1106] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 30 16:14:43.910146 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Going to try to terminate instance {{(pid=120697) delete /opt/stack/nova/nova/compute/api.py:2719}} Aug 30 16:14:44.009732 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-37aa57f0-f58a-4367-8175-66cc291a8c9b tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "DELETE /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 204 len: 0 microversion: 2.1 time: 0.143456 Aug 30 16:14:44.010441 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 550/1107] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:43 2022] DELETE /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 30 16:14:44.019274 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:44.021306 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:44.028553 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.029359 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.030470 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.031403 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:44.032068 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:44.032782 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:44.172680 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.policy [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120696) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:44.181685 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-3d4f94ab-f63c-45f6-8350-ad78b9cf6775 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1576 microversion: 2.1 time: 0.166722 Aug 30 16:14:44.182315 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 558/1108] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:44 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 30 16:14:45.203103 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:45.203783 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:45.210474 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.210950 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.211380 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.212057 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:45.212494 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:45.212901 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:45.361012 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:45.369008 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-96ce4307-811f-457c-8ce3-1d4b14766715 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1576 microversion: 2.1 time: 0.170122 Aug 30 16:14:45.369633 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 551/1109] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:45 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1576 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:46.178087 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [req-bb3094b1-f807-4eb9-a495-49608061a919 req-39c872b3-a09d-48b3-a886-75baa8a37502 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3c334ad9-ccb3-4514-ba5c-3db74a981527", "name": "network-vif-deleted", "tag": "b39a280c-762c-464e-8926-321969376208"}]} {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 30 16:14:46.188563 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bb3094b1-f807-4eb9-a495-49608061a919 req-39c872b3-a09d-48b3-a886-75baa8a37502 service nova] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.189036 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bb3094b1-f807-4eb9-a495-49608061a919 req-39c872b3-a09d-48b3-a886-75baa8a37502 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.189489 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [req-bb3094b1-f807-4eb9-a495-49608061a919 req-39c872b3-a09d-48b3-a886-75baa8a37502 service nova] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.201705 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.compute.server_external_events [req-bb3094b1-f807-4eb9-a495-49608061a919 req-39c872b3-a09d-48b3-a886-75baa8a37502 service nova] Creating event network-vif-deleted:b39a280c-762c-464e-8926-321969376208 for instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 on hv-cinder-85505 Aug 30 16:14:46.207143 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [req-bb3094b1-f807-4eb9-a495-49608061a919 req-39c872b3-a09d-48b3-a886-75baa8a37502 service nova] 10.222.0.20 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032718 Aug 30 16:14:46.207768 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 559/1110] 10.222.0.20 () {64 vars in 1317 bytes} [Tue Aug 30 16:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 30 16:14:46.391178 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:46.391840 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:46.399725 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.400264 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.400744 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.401555 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:46.402055 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:46.402521 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:46.471084 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.policy [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '02287f232cdd4842a747bb749b483cc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '330e7c1cf5894ac9b6d21915c5f645bc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120697) authorize /opt/stack/nova/nova/policy.py:199}} Aug 30 16:14:46.479698 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-6f82c419-3835-4a37-ba61-cb3ed21591a0 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 200 len: 1224 microversion: 2.1 time: 0.092790 Aug 30 16:14:46.480276 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 552/1111] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:46 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 1224 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 30 16:14:47.507072 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:47.508012 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 3c334ad9-ccb3-4514-ba5c-3db74a981527] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:47.518411 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.518924 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.519372 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.520066 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:47.520514 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:47.520937 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:47.536560 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] HTTP exception thrown: Instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 could not be found. Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Request method failure captured: Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 HTTP/1.1 Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjXtDMXJ6xGO8eXz90I9LKKKuX9vc-o1xY0QY91MCBAemRTvApJSvWiivQxXe0nLONE1TV5OT65KB4ce8Me9i3sze8yXKZG4YwdxZp0nEQ9kbDERaO-rjQhNOQKZZwUI4sv7c4iTQe1Pd5uUl1tidl5LIXhyrVp9i__3PGMWLaHihaM Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:14:47.538232 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 02287f232cdd4842a747bb749b483cc3 Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 could not be found. Aug 30 16:14:47.539944 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '3c334ad9-ccb3-4514-ba5c-3db74a981527'} Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 could not be found. Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:47.540887 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 could not be found. Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 could not be found. Aug 30 16:14:47.542343 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:47.543684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Returning 404 to user: Instance 3c334ad9-ccb3-4514-ba5c-3db74a981527 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:47.543684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-dd1c5c21-00f7-4b9c-aedb-42241c0475cb tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527" status: 404 len: 111 microversion: 2.1 time: 0.041378 Aug 30 16:14:47.543684 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 560/1112] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:47 2022] GET /compute/v2.1/servers/3c334ad9-ccb3-4514-ba5c-3db74a981527 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:47.994433 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:47.995045 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.compute.api [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120697) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:48.004089 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.004567 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.004997 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.005721 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.006165 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.006583 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG oslo_concurrency.lockutils [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120697) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.019893 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.wsgi [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] HTTP exception thrown: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Request method failure captured: Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: request: DELETE /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 HTTP/1.1 Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept: application/json Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Accept-Encoding: identity Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Connection: close Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Length: 0 Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Content-Type: application/json Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Host: 10.222.0.20 Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: Openstack-System-Scope: None Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Auth-Token: gAAAAABjDjXtDMXJ6xGO8eXz90I9LKKKuX9vc-o1xY0QY91MCBAemRTvApJSvWiivQxXe0nLONE1TV5OT65KB4ce8Me9i3sze8yXKZG4YwdxZp0nEQ9kbDERaO-rjQhNOQKZZwUI4sv7c4iTQe1Pd5uUl1tidl5LIXhyrVp9i__3PGMWLaHihaM Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Id: None Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Domain-Name: None Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Identity-Status: Confirmed Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Is-Admin-Project: True Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Id: default Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Domain-Name: Default Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Project-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Role: reader,member Aug 30 16:14:48.021591 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Roles: reader,member Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-Tenant-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Id: default Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Domain-Name: Default Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Id: 02287f232cdd4842a747bb749b483cc3 Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: X-User-Name: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: method: > Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: exception: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.023323 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: action_args: {'id': '0807429c-12cc-47c7-94a0-6e08488776a0'} Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:48.024235 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.025886 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.027574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Returning 404 to user: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. {{(pid=120697) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:48.027574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-28f98060-fa83-4961-9763-85275e946bdf tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "DELETE /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 404 len: 111 microversion: 2.1 time: 0.034370 Aug 30 16:14:48.027574 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 553/1113] 10.222.0.20 () {58 vars in 1239 bytes} [Tue Aug 30 16:14:47 2022] DELETE /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:48.031661 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '>' {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:48.032273 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.compute.api [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [instance: 0807429c-12cc-47c7-94a0-6e08488776a0] Fetching instance by UUID {{(pid=120696) get /opt/stack/nova/nova/compute/api.py:2975}} Aug 30 16:14:48.038703 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.039192 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.039624 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.040320 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Acquiring lock "e2381055-522d-452d-a836-2df87ca71581" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:385}} Aug 30 16:14:48.040776 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:390}} Aug 30 16:14:48.041195 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG oslo_concurrency.lockutils [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Lock "e2381055-522d-452d-a836-2df87ca71581" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120696) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Aug 30 16:14:48.054816 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.wsgi [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] HTTP exception thrown: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Request method failure captured: Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: request: GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 HTTP/1.1 Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept: application/json Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Accept-Encoding: identity Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Connection: close Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Length: 0 Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Content-Type: application/json Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Host: 10.222.0.20 Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: Openstack-System-Scope: None Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: User-Agent: python-urllib3/1.26.12 Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Auth-Token: gAAAAABjDjXtDMXJ6xGO8eXz90I9LKKKuX9vc-o1xY0QY91MCBAemRTvApJSvWiivQxXe0nLONE1TV5OT65KB4ce8Me9i3sze8yXKZG4YwdxZp0nEQ9kbDERaO-rjQhNOQKZZwUI4sv7c4iTQe1Pd5uUl1tidl5LIXhyrVp9i__3PGMWLaHihaM Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Id: None Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Domain-Name: None Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Identity-Status: Confirmed Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Is-Admin-Project: True Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Id: default Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Domain-Name: Default Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Project-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Role: reader,member Aug 30 16:14:48.056356 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Roles: reader,member Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Service-Catalog: [{"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/volume/v3/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/compute/v2/330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.20:8080", "publicURL": "http://10.222.0.20:8080/v1/AUTH_330e7c1cf5894ac9b6d21915c5f645bc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.20/identity"}]}] Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Id: 330e7c1cf5894ac9b6d21915c5f645bc Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-Tenant-Name: tempest-TestVolumeBootPattern-67327714 Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Id: default Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Domain-Name: Default Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Id: 02287f232cdd4842a747bb749b483cc3 Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: X-User-Name: tempest-TestVolumeBootPattern-67327714-project Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: method: > Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: exception: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.058070 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: action_args: {'id': '0807429c-12cc-47c7-94a0-6e08488776a0'} Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: {{(pid=120696) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Aug 30 16:14:48.059060 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = self._get_server( Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. Aug 30 16:14:48.060397 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: ERROR nova.api.openstack.wsgi Aug 30 16:14:48.061634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: DEBUG nova.api.openstack.wsgi [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Returning 404 to user: Instance 0807429c-12cc-47c7-94a0-6e08488776a0 could not be found. {{(pid=120696) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Aug 30 16:14:48.061634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: INFO nova.api.openstack.requestlog [None req-69bed0cf-6d50-4ddf-87b5-785be45a1d25 tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0" status: 404 len: 111 microversion: 2.1 time: 0.030034 Aug 30 16:14:48.061634 dv-cinder-855058-1-iscsi devstack@n-api.service[120696]: [pid: 120696|app: 0|req: 561/1114] 10.222.0.20 () {58 vars in 1236 bytes} [Tue Aug 30 16:14:48 2022] GET /compute/v2.1/servers/0807429c-12cc-47c7-94a0-6e08488776a0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 30 16:14:49.376161 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: DEBUG nova.api.openstack.wsgi [None req-f8dc311a-f7b6-4bb9-95ea-76814ad700bc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] Calling method '.version_select at 0x7f484819b1f0>' {{(pid=120697) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 30 16:14:49.380684 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: ERROR oslo.messaging._drivers.impl_rabbit [None req-f8dc311a-f7b6-4bb9-95ea-76814ad700bc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [abbc0d02-5909-4fd4-ae79-840822f1d0b1] AMQP server on 10.222.0.20:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 30 16:14:50.390876 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO oslo.messaging._drivers.impl_rabbit [None req-f8dc311a-f7b6-4bb9-95ea-76814ad700bc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] [abbc0d02-5909-4fd4-ae79-840822f1d0b1] Reconnected to AMQP server on 10.222.0.20:5672 via [amqp] client with port 49434. Aug 30 16:14:50.414405 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: INFO nova.api.openstack.requestlog [None req-f8dc311a-f7b6-4bb9-95ea-76814ad700bc tempest-TestVolumeBootPattern-67327714 tempest-TestVolumeBootPattern-67327714-project] 10.222.0.20 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-452120714" status: 202 len: 0 microversion: 2.1 time: 1.042118 Aug 30 16:14:50.414979 dv-cinder-855058-1-iscsi devstack@n-api.service[120697]: [pid: 120697|app: 0|req: 554/1115] 10.222.0.20 () {58 vars in 1260 bytes} [Tue Aug 30 16:14:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-452120714 => generated 0 bytes in 1043 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)